-- Logs begin at Wed 2022-08-17 18:07:56 UTC, end at Wed 2022-08-17 19:37:19 UTC. -- Aug 17 19:04:42.683135 dv-osbrick-853457-1-ceph systemd[1]: Starting Devstack devstack@keystone.service... Aug 17 19:04:42.695332 dv-osbrick-853457-1-ceph devstack@keystone.service[88538]: [uWSGI] getting INI configuration from /etc/keystone/keystone-uwsgi-public.ini Aug 17 19:04:42.697418 dv-osbrick-853457-1-ceph devstack@keystone.service[88538]: *** Starting uWSGI 2.0.18-debian (64bit) on [Wed Aug 17 19:04:42 2022] *** Aug 17 19:04:42.697418 dv-osbrick-853457-1-ceph devstack@keystone.service[88538]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Aug 17 19:04:42.697418 dv-osbrick-853457-1-ceph devstack@keystone.service[88538]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Aug 17 19:04:42.697418 dv-osbrick-853457-1-ceph devstack@keystone.service[88538]: nodename: dv-osbrick-853457-1-ceph Aug 17 19:04:42.697418 dv-osbrick-853457-1-ceph devstack@keystone.service[88538]: machine: x86_64 Aug 17 19:04:42.697418 dv-osbrick-853457-1-ceph devstack@keystone.service[88538]: clock source: unix Aug 17 19:04:42.697418 dv-osbrick-853457-1-ceph devstack@keystone.service[88538]: pcre jit disabled Aug 17 19:04:42.697418 dv-osbrick-853457-1-ceph devstack@keystone.service[88538]: detected number of CPU cores: 4 Aug 17 19:04:42.697418 dv-osbrick-853457-1-ceph devstack@keystone.service[88538]: current working directory: / Aug 17 19:04:42.697418 dv-osbrick-853457-1-ceph devstack@keystone.service[88538]: detected binary path: /usr/bin/uwsgi-core Aug 17 19:04:42.697418 dv-osbrick-853457-1-ceph devstack@keystone.service[88538]: your processes number limit is 47680 Aug 17 19:04:42.698163 dv-osbrick-853457-1-ceph devstack@keystone.service[88538]: your memory page size is 4096 bytes Aug 17 19:04:42.698163 dv-osbrick-853457-1-ceph devstack@keystone.service[88538]: detected max file descriptor number: 2048 Aug 17 19:04:42.698163 dv-osbrick-853457-1-ceph devstack@keystone.service[88538]: lock engine: pthread robust mutexes Aug 17 19:04:42.698163 dv-osbrick-853457-1-ceph devstack@keystone.service[88538]: thunder lock: enabled Aug 17 19:04:42.698163 dv-osbrick-853457-1-ceph devstack@keystone.service[88538]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/keystone-wsgi-public.socket fd 4 Aug 17 19:04:42.698163 dv-osbrick-853457-1-ceph devstack@keystone.service[88538]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Aug 17 19:04:42.743267 dv-osbrick-853457-1-ceph devstack@keystone.service[88538]: Python main interpreter initialized at 0x56508ab529c0 Aug 17 19:04:42.743267 dv-osbrick-853457-1-ceph devstack@keystone.service[88538]: python threads support enabled Aug 17 19:04:42.743267 dv-osbrick-853457-1-ceph devstack@keystone.service[88538]: your server socket listen backlog is limited to 100 connections Aug 17 19:04:42.743267 dv-osbrick-853457-1-ceph devstack@keystone.service[88538]: your mercy for graceful operations on workers is 90 seconds Aug 17 19:04:42.743640 dv-osbrick-853457-1-ceph devstack@keystone.service[88538]: mapped 403077 bytes (393 KB) for 2 cores Aug 17 19:04:42.743726 dv-osbrick-853457-1-ceph devstack@keystone.service[88538]: *** Operational MODE: preforking *** Aug 17 19:04:42.743951 dv-osbrick-853457-1-ceph devstack@keystone.service[88538]: *** uWSGI is running in multiple interpreter mode *** Aug 17 19:04:42.743951 dv-osbrick-853457-1-ceph devstack@keystone.service[88538]: spawned uWSGI master process (pid: 88538) Aug 17 19:04:42.744160 dv-osbrick-853457-1-ceph systemd[1]: Started Devstack devstack@keystone.service. Aug 17 19:04:42.745345 dv-osbrick-853457-1-ceph devstack@keystone.service[88538]: spawned uWSGI worker 1 (pid: 88550, cores: 1) Aug 17 19:04:42.745345 dv-osbrick-853457-1-ceph devstack@keystone.service[88538]: spawned uWSGI worker 2 (pid: 88551, cores: 1) Aug 17 19:04:42.745345 dv-osbrick-853457-1-ceph devstack@keystone.service[88538]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Aug 17 19:04:47.480385 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 17 19:04:47.480385 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: from cryptography.utils import int_from_bytes Aug 17 19:04:47.481171 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 17 19:04:47.481171 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: from cryptography.utils import int_from_bytes Aug 17 19:04:47.487077 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 17 19:04:47.487077 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: from cryptography.utils import int_from_bytes Aug 17 19:04:47.487556 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 17 19:04:47.487556 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: from cryptography.utils import int_from_bytes Aug 17 19:04:47.531221 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=88550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 17 19:04:47.531420 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=88550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 17 19:04:47.531606 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG uwsgi [-] command line args: [] {{(pid=88550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 17 19:04:47.531869 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=88550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 17 19:04:47.532044 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG uwsgi [-] ================================================================================ {{(pid=88550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 17 19:04:47.532294 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG uwsgi [-] admin_token = **** {{(pid=88550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 19:04:47.532538 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG uwsgi [-] config_dir = [] {{(pid=88550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 19:04:47.532721 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=88550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 19:04:47.532898 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG uwsgi [-] config_source = [] {{(pid=88550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 19:04:47.533073 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG uwsgi [-] debug = True {{(pid=88550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 19:04:47.533268 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=88550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 19:04:47.534445 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=88550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 19:04:47.534445 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG uwsgi [-] insecure_debug = False {{(pid=88550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 19:04:47.534445 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=88550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 19:04:47.534445 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=88550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 19:04:47.534738 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG uwsgi [-] list_limit = None {{(pid=88550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 19:04:47.534738 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG uwsgi [-] log_config_append = None {{(pid=88550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 19:04:47.534847 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=88550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 19:04:47.535018 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG uwsgi [-] log_dir = None {{(pid=88550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 19:04:47.535188 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG uwsgi [-] log_file = None {{(pid=88550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 19:04:47.535418 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=88550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 19:04:47.535671 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=88550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 19:04:47.535845 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=88551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 17 19:04:47.535927 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=88550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 19:04:47.536039 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=88551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 17 19:04:47.536148 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=88550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 19:04:47.536229 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG uwsgi [-] command line args: [] {{(pid=88551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 17 19:04:47.536348 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=88550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 19:04:47.536502 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=88551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 17 19:04:47.536599 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=88550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 19:04:47.536684 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG uwsgi [-] ================================================================================ {{(pid=88551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 17 19:04:47.536758 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=88550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 19:04:47.536920 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG uwsgi [-] admin_token = **** {{(pid=88551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 19:04:47.537016 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=88550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 19:04:47.537181 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG uwsgi [-] config_dir = [] {{(pid=88551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 19:04:47.537274 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=88550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 19:04:47.537338 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=88551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 19:04:47.537402 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=88550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 19:04:47.537535 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG uwsgi [-] config_source = [] {{(pid=88551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 19:04:47.537615 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=88550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 19:04:47.537675 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG uwsgi [-] debug = True {{(pid=88551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 19:04:47.537836 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=88550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 19:04:47.537930 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=88551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 19:04:47.538079 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=88550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 19:04:47.538165 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=88551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 19:04:47.538268 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG uwsgi [-] insecure_debug = False {{(pid=88551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 19:04:47.538353 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG uwsgi [-] notification_format = cadf {{(pid=88550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 19:04:47.538518 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=88551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 19:04:47.538673 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=88550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 19:04:47.538791 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=88551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 19:04:47.539023 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG uwsgi [-] list_limit = None {{(pid=88551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 19:04:47.539150 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.26/identity {{(pid=88550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 19:04:47.539235 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG uwsgi [-] log_config_append = None {{(pid=88551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 19:04:47.539314 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG uwsgi [-] publish_errors = False {{(pid=88550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 19:04:47.539430 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=88551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 19:04:47.539513 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=88550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 19:04:47.539636 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG uwsgi [-] log_dir = None {{(pid=88551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 19:04:47.539713 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=88550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 19:04:47.539784 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG uwsgi [-] log_file = None {{(pid=88551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 19:04:47.539862 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=88550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 19:04:47.539934 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=88551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 19:04:47.540058 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=88550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 19:04:47.540147 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=88551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 19:04:47.540288 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=88550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 19:04:47.540382 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=88551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 19:04:47.540517 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG uwsgi [-] standard_threads = False {{(pid=88550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 19:04:47.540595 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=88551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 19:04:47.540744 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG uwsgi [-] strict_password_check = False {{(pid=88550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 19:04:47.540835 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=88551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 19:04:47.540939 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=88551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 19:04:47.541022 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=88550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 19:04:47.541144 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG uwsgi [-] use_eventlog = False {{(pid=88550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 19:04:47.541228 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=88551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 19:04:47.541309 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG uwsgi [-] use_journal = False {{(pid=88550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 19:04:47.541413 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=88551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 19:04:47.541492 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG uwsgi [-] use_json = False {{(pid=88550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 19:04:47.541634 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG uwsgi [-] use_stderr = False {{(pid=88550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 19:04:47.541718 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=88551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 19:04:47.541791 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG uwsgi [-] use_syslog = False {{(pid=88550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 19:04:47.541914 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=88551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 19:04:47.542019 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG uwsgi [-] watch_log_file = False {{(pid=88550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 19:04:47.542119 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=88551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 19:04:47.542269 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=88550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:04:47.542381 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=88551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 19:04:47.542502 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=88550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:04:47.542701 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=88551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 19:04:47.542801 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=88550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:04:47.542903 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG uwsgi [-] notification_format = cadf {{(pid=88551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 19:04:47.543013 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=88550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:04:47.543117 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=88551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 19:04:47.543249 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=88550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:04:47.543485 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=88550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:04:47.543569 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.26/identity {{(pid=88551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 19:04:47.543720 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG uwsgi [-] publish_errors = False {{(pid=88551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 19:04:47.543809 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=88550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:04:47.543951 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=88551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 19:04:47.544030 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=88550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:04:47.544183 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=88551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 19:04:47.544262 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=88550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:04:47.544362 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=88551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 19:04:47.544450 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=88550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:04:47.544609 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=88551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 19:04:47.544692 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=88550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:04:47.544842 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=88551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 19:04:47.544920 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=88550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:04:47.545073 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG uwsgi [-] standard_threads = False {{(pid=88551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 19:04:47.545232 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=88550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:04:47.545309 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG uwsgi [-] strict_password_check = False {{(pid=88551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 19:04:47.545385 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=88550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:04:47.545532 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=88551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 19:04:47.545610 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=88550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:04:47.545710 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG uwsgi [-] use_eventlog = False {{(pid=88551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 19:04:47.545798 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=88550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:04:47.545871 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG uwsgi [-] use_journal = False {{(pid=88551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 19:04:47.546017 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=88550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:04:47.546101 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG uwsgi [-] use_json = False {{(pid=88551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 19:04:47.546207 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG uwsgi [-] use_stderr = False {{(pid=88551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 19:04:47.546292 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=88550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:04:47.546373 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG uwsgi [-] use_syslog = False {{(pid=88551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 19:04:47.546505 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=88550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:04:47.547155 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG uwsgi [-] watch_log_file = False {{(pid=88551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 19:04:47.547279 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=88550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:04:47.547415 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=88551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:04:47.547503 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=88550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:04:47.547655 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=88551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:04:47.547734 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=88550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:04:47.547914 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=88551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:04:47.547992 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=88550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:04:47.548153 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=88551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:04:47.548242 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=88550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:04:47.548403 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=88551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:04:47.548487 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=88550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:04:47.548642 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=88551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:04:47.548722 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=88550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:04:47.548889 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=88551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:04:47.548979 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=88550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:04:47.549115 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=88550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:04:47.549197 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=88551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:04:47.549345 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=88550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:04:47.549423 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=88551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:04:47.549590 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=88550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:04:47.549677 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=88551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:04:47.549834 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=88550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:04:47.549912 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=88551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:04:47.550062 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=88550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:04:47.550141 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=88551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:04:47.550290 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=88550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:04:47.550377 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=88551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:04:47.550526 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=88551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:04:47.550657 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=88550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:04:47.550793 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=88550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:04:47.550872 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=88551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:04:47.551027 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=88550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:04:47.551179 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=88551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:04:47.551254 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=88551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:04:47.551373 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=88550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:04:47.551491 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=88550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:04:47.551576 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=88551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:04:47.551726 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=88550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:04:47.551812 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=88551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:04:47.551960 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=88550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:04:47.552038 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=88551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:04:47.552188 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=88550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:04:47.552266 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=88551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:04:47.552418 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=88550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:04:47.552507 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=88551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:04:47.552646 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=88550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:04:47.552724 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=88551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:04:47.552874 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=88550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:04:47.552958 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=88551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:04:47.553106 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=88550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:04:47.553193 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=88551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:04:47.553350 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=88550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:04:47.553428 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=88551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:04:47.553578 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=88550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:04:47.553663 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=88551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:04:47.553810 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=88550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:04:47.553897 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=88551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:04:47.554036 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=88550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:04:47.554120 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=88551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:04:47.554268 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=88550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:04:47.554383 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=88551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:04:47.554500 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=88550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:04:47.554616 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=88551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:04:47.554764 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=88551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:04:47.554842 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=88550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:04:47.554992 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=88550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:04:47.555080 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=88551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:04:47.555226 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=88550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:04:47.555306 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=88551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:04:47.555459 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=88550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:04:47.555545 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=88551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:04:47.555697 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=88551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:04:47.555775 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=88550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:04:47.555928 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=88550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:04:47.556008 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=88551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:04:47.556158 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=88550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:04:47.556237 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=88551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:04:47.556385 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=88550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:04:47.556463 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=88551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:04:47.556618 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=88551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:04:47.556697 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=88550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:04:47.556849 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=88551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:04:47.556929 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=88550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:04:47.557080 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=88550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:04:47.557428 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=88551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:04:47.557573 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=88551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:04:47.557659 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=88550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:04:47.557805 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=88551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:04:47.557895 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=88550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:04:47.558041 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=88551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:04:47.558125 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=88550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:04:47.558266 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=88550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:04:47.558345 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=88551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:04:47.558500 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=88550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:04:47.558628 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=88551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:04:47.558757 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=88550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:04:47.558847 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=88551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:04:47.558987 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=88551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:04:47.559071 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=88550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:04:47.559223 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=88551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:04:47.559304 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=88550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:04:47.559458 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=88551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:04:47.559544 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=88550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:04:47.559708 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=88551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:04:47.559786 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=88550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:04:47.559940 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=88550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:04:47.560019 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=88551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:04:47.560172 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=88550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:04:47.560258 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=88551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:04:47.560405 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=88551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:04:47.560484 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=88550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:04:47.560642 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=88551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:04:47.560722 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG uwsgi [-] cache.enabled = True {{(pid=88550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:04:47.560874 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=88550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:04:47.560953 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=88551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:04:47.561108 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=88551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:04:47.561201 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=88550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:04:47.561338 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=88551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:04:47.561417 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=88550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:04:47.561572 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=88550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:04:47.561655 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=88551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:04:47.561808 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=88550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:04:47.561894 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=88551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:04:47.562040 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=88550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:04:47.562118 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=88551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:04:47.562295 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=88550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:04:47.562930 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=88551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:04:47.563137 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=88550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:04:47.563232 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=88551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:04:47.563383 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=88551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:04:47.563458 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=88550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:04:47.563614 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=88551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:04:47.563733 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=88550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:04:47.563853 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=88550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:04:47.563944 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=88551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:04:47.564089 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=88551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:04:47.564169 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=88550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:04:47.564327 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=88550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:04:47.564405 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=88551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:04:47.564562 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=88550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:04:47.564649 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=88551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:04:47.564798 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=88550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:04:47.564886 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=88551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:04:47.565032 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=88550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:04:47.565117 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=88551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:04:47.565261 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=88550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:04:47.565352 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=88551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:04:47.565491 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=88550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:04:47.565577 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=88551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:04:47.565724 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=88551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:04:47.565802 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=88550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:04:47.565954 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=88550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:04:47.566032 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG uwsgi [-] cache.enabled = True {{(pid=88551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:04:47.566183 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=88550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:04:47.566270 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=88551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:04:47.566424 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=88550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:04:47.566519 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=88551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:04:47.566680 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=88550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:04:47.566785 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=88551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:04:47.566927 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=88551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:04:47.567022 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=88550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:04:47.567160 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=88550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:04:47.567247 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=88551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:04:47.567394 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=88551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:04:47.567481 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=88550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:04:47.567632 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=88551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:04:47.567728 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=88550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:04:47.567870 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=88551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:04:47.567964 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=88550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:04:47.568099 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG uwsgi [-] auth.external = None {{(pid=88550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:04:47.568191 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=88551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:04:47.568328 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG uwsgi [-] auth.mapped = None {{(pid=88550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:04:47.568424 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=88551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:04:47.568589 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=88551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:04:47.568675 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=88550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:04:47.568841 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=88550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:04:47.568952 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=88551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:04:47.569068 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG uwsgi [-] auth.password = None {{(pid=88550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:04:47.569200 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=88551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:04:47.569281 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG uwsgi [-] auth.token = None {{(pid=88550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:04:47.569443 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=88551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:04:47.569522 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=88550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:04:47.569686 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=88551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:04:47.569765 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG uwsgi [-] catalog.caching = True {{(pid=88550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:04:47.569926 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=88551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:04:47.570083 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=88550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:04:47.570163 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=88551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:04:47.570317 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=88550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:04:47.570397 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=88551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:04:47.570588 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=88550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:04:47.570701 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=88551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:04:47.570840 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=88550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:04:47.570927 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=88551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:04:47.571072 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=88550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:04:47.571187 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=88551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:04:47.571307 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG uwsgi [-] credential.caching = True {{(pid=88550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:04:47.571399 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=88551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:04:47.571542 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=88551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:04:47.571630 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG uwsgi [-] credential.driver = sql {{(pid=88550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:04:47.571792 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=88550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:04:47.571873 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=88551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:04:47.572030 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=88551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:04:47.572109 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=88550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:04:47.572264 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=88550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:04:47.572351 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=88551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:04:47.572507 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=88550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:04:47.572588 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=88551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:04:47.572740 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=88550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:04:47.572821 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=88551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:04:47.572987 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG uwsgi [-] auth.external = None {{(pid=88551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:04:47.573077 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=88550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:04:47.573220 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG uwsgi [-] auth.mapped = None {{(pid=88551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:04:47.573300 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=88550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:04:47.573469 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=88550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:04:47.573548 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=88551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:04:47.573721 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=88550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:04:47.573809 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=88551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:04:47.573962 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG uwsgi [-] auth.password = None {{(pid=88551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:04:47.574042 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=88550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:04:47.574196 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG uwsgi [-] auth.token = None {{(pid=88551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:04:47.574276 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=88550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:04:47.574437 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=88551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:04:47.574518 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=88550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:04:47.574698 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG uwsgi [-] catalog.caching = True {{(pid=88551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:04:47.574781 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=88550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:04:47.574949 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=88551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:04:47.575029 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=88550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:04:47.575181 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=88551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:04:47.575269 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG uwsgi [-] federation.caching = True {{(pid=88550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:04:47.575428 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=88550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:04:47.575508 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=88551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:04:47.575674 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=88551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:04:47.575761 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG uwsgi [-] federation.driver = sql {{(pid=88550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:04:47.575906 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=88551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:04:47.575988 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=88550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:04:47.576136 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=88550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:04:47.576215 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG uwsgi [-] credential.caching = True {{(pid=88551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:04:47.576382 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG uwsgi [-] credential.driver = sql {{(pid=88551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:04:47.576461 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=88550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:04:47.576616 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=88550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:04:47.576697 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=88551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:04:47.576867 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=88551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:04:47.576946 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=88550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:04:47.577099 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=88550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:04:47.577179 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=88551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:04:47.577330 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=88551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:04:47.577413 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=88550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:04:47.577569 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=88551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:04:47.577653 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=88550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:04:47.577805 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=88550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:04:47.577918 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=88551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:04:47.578063 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG uwsgi [-] identity.caching = True {{(pid=88550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:04:47.578145 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=88551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:04:47.578309 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=88550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:04:47.578389 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=88551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:04:47.578606 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=88550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:04:47.578703 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=88551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:04:47.578808 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=88550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:04:47.578890 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=88551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:04:47.579039 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=88550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:04:47.579119 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=88551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:04:47.579284 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG uwsgi [-] identity.driver = sql {{(pid=88550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:04:47.579364 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=88551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:04:47.579514 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=88550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:04:47.579596 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=88551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:04:47.579748 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=88550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:04:47.579828 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=88551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:04:47.579995 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=88550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:04:47.580074 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG uwsgi [-] federation.caching = True {{(pid=88551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:04:47.580245 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=88550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:04:47.580326 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=88551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:04:47.580473 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=88550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:04:47.580558 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG uwsgi [-] federation.driver = sql {{(pid=88551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:04:47.580699 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=88550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:04:47.580780 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=88551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:04:47.580927 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=88550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:04:47.581009 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=88551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:04:47.581168 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=88550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:04:47.581247 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=88551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:04:47.581412 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=88551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:04:47.581490 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=88550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:04:47.581674 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=88550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:04:47.581807 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=88551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:04:47.581886 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=88551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:04:47.581967 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=88550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:04:47.582134 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=88551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:04:47.582215 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=88550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:04:47.582372 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=88551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:04:47.582459 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=88550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:04:47.582642 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=88550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:04:47.582722 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=88551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:04:47.582879 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=88550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:04:47.582958 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG uwsgi [-] identity.caching = True {{(pid=88551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:04:47.583106 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=88550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:04:47.583188 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=88551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:04:47.583337 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=88550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:04:47.583416 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=88551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:04:47.583562 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=88550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:04:47.583653 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=88551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:04:47.583794 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=88550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:04:47.583881 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=88551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:04:47.584032 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=88550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:04:47.584113 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG uwsgi [-] identity.driver = sql {{(pid=88551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:04:47.584262 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=88551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:04:47.584348 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=88550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:04:47.584501 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=88551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:04:47.584581 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=88550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:04:47.584727 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=88550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:04:47.584806 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=88551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:04:47.584973 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=88550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:04:47.585061 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=88551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:04:47.585213 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=88551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:04:47.585292 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=88550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:04:47.585443 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=88550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:04:47.585521 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=88551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:04:47.585671 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=88551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:04:47.585758 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=88550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:04:47.585917 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=88551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:04:47.585998 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=88550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:04:47.586144 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=88550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:04:47.586223 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=88551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:04:47.586378 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=88550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:04:47.586469 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=88551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:04:47.586627 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG uwsgi [-] ldap.password = **** {{(pid=88550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:04:47.586711 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=88551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:04:47.586862 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=88550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:04:47.586942 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=88551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:04:47.587095 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=88550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:04:47.587187 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=88551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:04:47.587331 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=88550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:04:47.587411 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=88551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:04:47.587565 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=88550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:04:47.587644 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=88551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:04:47.587797 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=88550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:04:47.587896 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=88551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:04:47.588045 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=88550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:04:47.588125 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=88551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:04:47.588274 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=88551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:04:47.588353 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=88550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:04:47.588508 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=88550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:04:47.588595 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=88551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:04:47.588736 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=88550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:04:47.588815 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=88551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:04:47.588972 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=88551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:04:47.589058 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=88550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:04:47.589215 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=88550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:04:47.589303 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=88551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:04:47.589445 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=88551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:04:47.589524 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=88550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:04:47.589675 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=88550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:04:47.589753 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=88551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:04:47.589904 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=88550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:04:47.589992 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=88551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:04:47.590132 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG uwsgi [-] ldap.user = None {{(pid=88550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:04:47.590211 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=88551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:04:47.590369 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=88550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:04:47.590448 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=88551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:04:47.590640 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=88551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:04:47.590735 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=88550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:04:47.590869 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=88550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:04:47.590953 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=88551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:04:47.591104 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=88551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:04:47.591183 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=88550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:04:47.591334 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG uwsgi [-] ldap.password = **** {{(pid=88551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:04:47.591423 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=88550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:04:47.591582 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=88551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:04:47.591709 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=88550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:04:47.591787 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=88550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:04:47.591860 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=88551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:04:47.592006 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=88550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:04:47.592097 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=88551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:04:47.592237 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=88550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:04:47.592317 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=88551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:04:47.592466 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=88550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:04:47.592546 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=88551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:04:47.592698 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=88550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:04:47.592788 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=88551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:04:47.592926 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=88550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:04:47.593007 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=88551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:04:47.593166 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=88551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:04:47.593245 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=88550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:04:47.593397 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=88551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:04:47.593486 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=88550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:04:47.593663 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=88550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:04:47.593743 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=88551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:04:47.593906 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=88550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:04:47.593992 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=88551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:04:47.594148 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=88550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:04:47.594237 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=88551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:04:47.594375 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=88550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:04:47.594454 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=88551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:04:47.594632 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=88551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:04:47.594715 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=88550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:04:47.594867 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG uwsgi [-] ldap.user = None {{(pid=88551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:04:47.594960 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=88550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:04:47.595101 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=88550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:04:47.595180 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=88551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:04:47.595335 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=88550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:04:47.595417 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=88551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:04:47.595568 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=88550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:04:47.595656 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=88551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:04:47.595814 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=88551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:04:47.595893 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=88550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:04:47.596058 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=88550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:04:47.596137 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=88551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:04:47.596292 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=88550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:04:47.596375 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=88551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:04:47.596524 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=88551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:04:47.596602 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG uwsgi [-] policy.driver = sql {{(pid=88550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:04:47.596754 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=88551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:04:47.596833 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=88550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:04:47.596987 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=88551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:04:47.597069 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=88550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:04:47.597218 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=88550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:04:47.597298 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=88551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:04:47.597450 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG uwsgi [-] receipt.caching = True {{(pid=88550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:04:47.597530 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=88551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:04:47.597679 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=88551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:04:47.597760 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=88550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:04:47.597921 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=88550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:04:47.598000 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=88551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:04:47.598159 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=88550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:04:47.598239 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=88551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:04:47.598387 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=88550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:04:47.598469 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=88551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:04:47.598643 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=88550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:04:47.598763 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=88551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:04:47.598881 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG uwsgi [-] resource.caching = True {{(pid=88550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:04:47.598961 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=88551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:04:47.599126 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=88551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:04:47.599206 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=88550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:04:47.599369 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG uwsgi [-] resource.driver = sql {{(pid=88550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:04:47.599448 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=88551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:04:47.599604 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=88550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:04:47.599690 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=88551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:04:47.599843 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=88551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:04:47.599919 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=88550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:04:47.600058 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=88551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:04:47.600138 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=88550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:04:47.600294 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=88551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:04:47.600374 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG uwsgi [-] revoke.caching = True {{(pid=88550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:04:47.600535 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=88550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:04:47.600615 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=88551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:04:47.600769 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=88550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:04:47.600849 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=88551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:04:47.601002 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=88551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:04:47.601081 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG uwsgi [-] role.cache_time = None {{(pid=88550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:04:47.601231 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG uwsgi [-] role.caching = True {{(pid=88550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:04:47.601311 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG uwsgi [-] policy.driver = sql {{(pid=88551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:04:47.601475 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=88551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:04:47.601554 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG uwsgi [-] role.driver = sql {{(pid=88550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:04:47.601700 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG uwsgi [-] role.list_limit = None {{(pid=88550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:04:47.601779 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=88551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:04:47.601942 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=88551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:04:47.602022 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=88550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:04:47.602176 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG uwsgi [-] receipt.caching = True {{(pid=88551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:04:47.602256 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=88550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:04:47.602413 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=88551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:04:47.602493 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=88550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:04:47.602675 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=88550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:04:47.602758 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=88551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:04:47.602920 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=88550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:04:47.603003 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=88551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:04:47.603152 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=88551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:04:47.603230 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=88550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:04:47.603392 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=88551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:04:47.603473 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=88550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:04:47.603633 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG uwsgi [-] resource.caching = True {{(pid=88551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:04:47.603713 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=88550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:04:47.603859 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=88550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:04:47.603984 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=88551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:04:47.604101 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=88550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:04:47.604186 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG uwsgi [-] resource.driver = sql {{(pid=88551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:04:47.604343 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=88551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:04:47.604422 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=88550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:04:47.604585 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=88550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:04:47.604670 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=88551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:04:47.604828 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=88550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:04:47.604910 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=88551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:04:47.605063 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG uwsgi [-] revoke.caching = True {{(pid=88551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:04:47.605220 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=88550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:04:47.605300 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=88551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:04:47.605452 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=88550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:04:47.605539 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=88551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:04:47.605704 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=88550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:04:47.605784 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG uwsgi [-] role.cache_time = None {{(pid=88551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:04:47.605951 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=88550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:04:47.606030 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG uwsgi [-] role.caching = True {{(pid=88551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:04:47.606197 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=88550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:04:47.606285 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG uwsgi [-] role.driver = sql {{(pid=88551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:04:47.606432 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG uwsgi [-] role.list_limit = None {{(pid=88551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:04:47.606510 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=88550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:04:47.606685 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=88550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:04:47.606767 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=88551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:04:47.606937 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=88550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:04:47.607019 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=88551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:04:47.607184 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=88551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:04:47.607263 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=88550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:04:47.607419 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=88550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:04:47.607498 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=88551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:04:47.607649 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=88550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:04:47.607730 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=88551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:04:47.607879 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=88550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:04:47.607959 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=88551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:04:47.608107 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=88550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:04:47.608188 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=88551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:04:47.608355 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=88550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:04:47.608437 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=88551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:04:47.608586 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=88551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:04:47.608664 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=88550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:04:47.608834 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=88551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:04:47.608914 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=88550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:04:47.609065 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=88550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:04:47.609718 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=88551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:04:47.609819 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=88550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:04:47.609900 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=88551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:04:47.610047 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG uwsgi [-] token.cache_time = None {{(pid=88550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:04:47.610128 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=88551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:04:47.610281 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG uwsgi [-] token.caching = True {{(pid=88550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:04:47.610484 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=88551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:04:47.610584 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=88550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:04:47.610753 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=88551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:04:47.610834 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG uwsgi [-] token.provider = fernet {{(pid=88550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:04:47.611000 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=88550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:04:47.611095 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=88551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:04:47.611250 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=88551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:04:47.611329 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=88550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:04:47.611493 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=88550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:04:47.611572 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=88551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:04:47.611724 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=88550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:04:47.611813 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=88551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:04:47.611963 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=88551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:04:47.612042 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=88550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:04:47.612200 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=88550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:04:47.612279 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=88551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:04:47.612443 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG uwsgi [-] trust.driver = sql {{(pid=88550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:04:47.612531 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=88551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:04:47.612676 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=88550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:04:47.612755 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=88551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:04:47.612907 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=88551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:04:47.612986 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=88550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:04:47.613134 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=88550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:04:47.613221 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=88551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:04:47.613365 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=88551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:04:47.613445 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=88550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:04:47.613611 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=88550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:04:47.613690 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=88551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:04:47.613837 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=88550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:04:47.613924 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=88551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:04:47.614074 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=88550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:04:47.614157 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=88551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:04:47.614324 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=88551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:04:47.614403 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=88550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:04:47.614580 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=88551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:04:47.614666 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG uwsgi [-] database.connection = **** {{(pid=88550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:04:47.614817 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG uwsgi [-] token.cache_time = None {{(pid=88551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:04:47.614907 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=88550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:04:47.615054 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG uwsgi [-] token.caching = True {{(pid=88551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:04:47.615135 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=88550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:04:47.615291 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=88551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:04:47.615371 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=88550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:04:47.615542 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG uwsgi [-] token.provider = fernet {{(pid=88551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:04:47.615624 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=88550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:04:47.615777 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=88550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:04:47.615856 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=88551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:04:47.616011 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=88550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:04:47.616090 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=88551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:04:47.616243 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=88550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:04:47.616325 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=88551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:04:47.616475 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=88550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:04:47.616555 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=88551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:04:47.616715 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=88550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:04:47.616795 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=88551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:04:47.616946 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=88550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:04:47.617028 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=88551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:04:47.617186 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=88550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:04:47.617266 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG uwsgi [-] trust.driver = sql {{(pid=88551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:04:47.617416 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=88550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:04:47.617497 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=88551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:04:47.617652 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=88551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:04:47.617733 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=88550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:04:47.617882 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=88550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:04:47.617961 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=88551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:04:47.618121 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=88550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:04:47.618202 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=88551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:04:47.618349 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=88550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:04:47.618433 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=88551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:04:47.618607 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=88551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:04:47.618688 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=88550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:04:47.618840 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=88550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:04:47.618920 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=88551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:04:47.619006 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=88550) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 17 19:04:47.619139 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=88551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:04:47.619404 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG uwsgi [-] database.connection = **** {{(pid=88551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:04:47.619652 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=88551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:04:47.619903 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=88551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:04:47.620142 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=88551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:04:47.620389 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=88551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:04:47.620624 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=88551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:04:47.620861 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=88551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:04:47.621098 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=88551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:04:47.621335 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=88551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:04:47.621580 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=88551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:04:47.621817 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=88551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:04:47.622061 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=88551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:04:47.622295 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=88551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:04:47.622605 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=88551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:04:47.622875 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=88551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:04:47.623850 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=88551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:04:47.624095 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=88551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:04:47.624340 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=88551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:04:47.624579 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=88551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:04:47.625799 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=88551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 17 19:04:47.648765 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=88550) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 17 19:04:47.648981 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=88550) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 17 19:04:47.649198 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=88550) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 17 19:04:47.651280 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=88551) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 17 19:04:47.651515 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=88551) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 17 19:04:47.651741 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=88551) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 17 19:04:47.658208 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=88550) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 17 19:04:47.660391 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=88551) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 17 19:04:47.688959 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=88550) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 17 19:04:47.689188 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=88550) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 17 19:04:47.689600 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=88551) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 17 19:04:47.689835 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=88551) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 17 19:04:47.742980 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=88550) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 17 19:04:47.743207 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=88551) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 17 19:04:47.793381 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=88550) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 17 19:04:47.793560 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=88551) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 17 19:04:47.793631 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=88551) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 17 19:04:47.793707 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=88550) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 17 19:04:47.862873 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=88550) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 17 19:04:47.863058 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=88551) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 17 19:04:47.863137 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=88550) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 17 19:04:47.863274 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=88551) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 17 19:04:47.863360 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=88550) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 17 19:04:47.863498 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=88551) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 17 19:04:47.863582 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=88550) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 17 19:04:47.863717 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=88550) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 17 19:04:47.863798 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=88551) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 17 19:04:47.863932 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=88550) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 17 19:04:47.864016 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=88551) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 17 19:04:47.864146 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=88551) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 17 19:04:47.887968 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=88550) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 17 19:04:47.888179 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=88551) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 17 19:04:47.888269 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=88550) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 17 19:04:47.888412 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=88550) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 17 19:04:47.888513 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=88551) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 17 19:04:47.888637 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=88551) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 17 19:04:47.888719 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=88550) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 17 19:04:47.888857 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=88550) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 17 19:04:47.888939 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=88551) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 17 19:04:47.889074 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=88551) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 17 19:04:47.889157 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=88550) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 17 19:04:47.889291 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=88550) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 17 19:04:47.889372 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=88551) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 17 19:04:47.889503 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=88551) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 17 19:04:47.901349 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=88550) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 17 19:04:47.901730 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=88551) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 17 19:04:47.914226 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=88550) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 17 19:04:47.914515 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=88550) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 17 19:04:47.914633 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=88551) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 17 19:04:47.914712 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=88550) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 17 19:04:47.914804 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=88551) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 17 19:04:47.914912 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=88550) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 17 19:04:47.914995 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=88551) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 17 19:04:47.915125 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=88550) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 17 19:04:47.915207 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=88551) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 17 19:04:47.915338 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=88550) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 17 19:04:47.915422 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=88551) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 17 19:04:47.915551 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=88550) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 17 19:04:47.915634 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=88551) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 17 19:04:47.915762 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=88551) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 17 19:04:47.932902 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=88550) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 19:04:47.933096 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=88550) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Aug 17 19:04:47.933450 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=88550) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 19:04:47.933654 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=88550) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Aug 17 19:04:47.933738 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=88551) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 19:04:47.933869 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=88551) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Aug 17 19:04:47.933960 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=88550) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 19:04:47.934190 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=88550) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 19:04:47.934274 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=88551) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 19:04:47.934403 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=88551) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Aug 17 19:04:47.934485 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=88550) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 19:04:47.934721 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=88551) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 19:04:47.934818 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=88550) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 19:04:47.934987 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=88551) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 19:04:47.935248 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=88551) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 19:04:47.935510 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=88551) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 19:04:47.945184 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=88550) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 19:04:47.945184 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=88550) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 19:04:47.945421 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=88550) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 19:04:47.945691 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=88551) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 19:04:47.945775 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=88550) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 19:04:47.945984 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=88551) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 19:04:47.946260 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=88551) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 19:04:47.946567 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=88551) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 19:04:47.952721 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `type` (API Prefix: ) [/credentials, /credentials/] {{(pid=88550) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 17 19:04:47.954207 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `type` (API Prefix: ) [/credentials, /credentials/] {{(pid=88551) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 17 19:04:47.956356 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `type` (API Prefix: ) [/domains, /domains/] {{(pid=88550) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 17 19:04:47.956647 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=88550) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 19:04:47.956944 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=88550) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 19:04:47.957120 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `type` (API Prefix: ) [/domains, /domains/] {{(pid=88551) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 17 19:04:47.957247 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=88550) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 19:04:47.957408 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=88551) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 19:04:47.957543 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=88550) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 19:04:47.957690 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=88551) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 19:04:47.957822 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=88550) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 19:04:47.957970 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=88551) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 19:04:47.958093 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=88550) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 19:04:47.958246 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=88551) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 19:04:47.958382 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=88550) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 19:04:47.958512 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=88551) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 19:04:47.958662 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=88550) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 19:04:47.958807 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=88551) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 19:04:47.958890 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=88550) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 19:04:47.959082 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=88551) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 19:04:47.959165 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=88550) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 19:04:47.959355 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=88551) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 19:04:47.959632 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=88551) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 19:04:47.960038 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=88551) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 19:04:47.983406 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=88551) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 19:04:47.984280 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=88550) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 19:04:47.985531 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `type` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=88551) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 17 19:04:47.985816 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=88551) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 19:04:47.986277 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `type` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=88550) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 17 19:04:47.986589 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=88550) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 19:04:47.990422 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `type` (API Prefix: ) [/groups, /groups/] {{(pid=88551) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 17 19:04:47.990731 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=88551) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 19:04:47.991148 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `type` (API Prefix: ) [/groups, /groups/] {{(pid=88550) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 17 19:04:47.991575 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=88550) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 19:04:47.991842 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=88550) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 19:04:47.992742 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=88551) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 19:04:47.998254 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `type` (API Prefix: ) [/limits, /limits/] {{(pid=88550) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 17 19:04:47.998504 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=88550) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 19:04:47.999258 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `type` (API Prefix: ) [/limits, /limits/] {{(pid=88551) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 17 19:04:47.999548 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=88551) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 19:04:48.002503 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `type` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=88550) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 17 19:04:48.002825 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=88550) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 19:04:48.003114 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=88550) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 19:04:48.003517 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=88550) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 19:04:48.003647 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `type` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=88551) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 17 19:04:48.003801 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=88550) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 19:04:48.003954 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=88551) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 19:04:48.004086 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=88550) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 19:04:48.004238 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=88551) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 19:04:48.004364 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=88550) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 19:04:48.004641 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=88551) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 19:04:48.004730 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=88550) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 19:04:48.004922 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=88551) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 19:04:48.005217 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=88551) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 19:04:48.005491 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=88551) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 19:04:48.005769 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=88551) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 19:04:48.020017 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=88550) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 19:04:48.020301 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=88550) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 19:04:48.021281 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=88551) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 19:04:48.021563 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=88551) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 19:04:48.024179 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `type` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=88550) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 17 19:04:48.025454 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `type` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=88551) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 17 19:04:48.027326 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=88550) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 19:04:48.027738 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=88550) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 19:04:48.028580 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=88551) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 19:04:48.028993 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=88551) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 19:04:48.032491 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `type` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=88550) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 17 19:04:48.033781 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `type` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=88551) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 17 19:04:48.035652 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `type` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=88550) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 17 19:04:48.036930 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `type` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=88551) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 17 19:04:48.038763 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=88550) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 19:04:48.039067 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=88550) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 19:04:48.039357 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=88550) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 19:04:48.039765 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=88550) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 19:04:48.040058 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=88550) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 19:04:48.040142 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=88551) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 19:04:48.040354 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=88550) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 19:04:48.040448 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=88551) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 19:04:48.040642 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=88551) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 19:04:48.041036 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=88551) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 19:04:48.041322 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=88551) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 19:04:48.041617 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=88551) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 19:04:48.056640 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `type` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=88550) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 17 19:04:48.056937 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=88550) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 19:04:48.057475 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=88550) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 19:04:48.057741 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=88550) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 19:04:48.058218 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `type` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=88551) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 17 19:04:48.058513 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=88551) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 19:04:48.058810 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=88551) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 19:04:48.059078 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=88551) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 19:04:48.064587 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=88550) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 19:04:48.065864 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=88551) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 19:04:48.066257 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=88550) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 19:04:48.066561 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=88550) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 19:04:48.067572 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=88551) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 19:04:48.067859 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=88551) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 19:04:48.069234 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `type` (API Prefix: ) [/policies, /policies/] {{(pid=88550) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 17 19:04:48.069534 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=88550) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 19:04:48.069822 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=88550) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 19:04:48.070117 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=88550) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 19:04:48.070402 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=88550) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 19:04:48.070486 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `type` (API Prefix: ) [/policies, /policies/] {{(pid=88551) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 17 19:04:48.070795 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=88551) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 19:04:48.071098 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=88551) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 19:04:48.071386 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=88551) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 19:04:48.071689 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=88551) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 19:04:48.081633 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `type` (API Prefix: ) [/projects, /projects/] {{(pid=88550) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 17 19:04:48.081926 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=88550) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 19:04:48.082214 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=88550) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 19:04:48.082574 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=88550) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 19:04:48.082811 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=88550) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 19:04:48.082935 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `type` (API Prefix: ) [/projects, /projects/] {{(pid=88551) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 17 19:04:48.083110 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=88550) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 19:04:48.083213 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=88551) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 19:04:48.083392 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=88550) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 19:04:48.083477 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=88551) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 19:04:48.083775 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=88551) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 19:04:48.084061 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=88551) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 19:04:48.084339 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=88551) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 19:04:48.084635 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=88551) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 19:04:48.099285 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `type` (API Prefix: ) [/regions, /regions/] {{(pid=88550) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 17 19:04:48.100479 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `type` (API Prefix: ) [/regions, /regions/] {{(pid=88551) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 17 19:04:48.102174 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `type` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=88550) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 17 19:04:48.103405 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `type` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=88551) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 17 19:04:48.105218 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=88550) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 19:04:48.106396 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=88551) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 19:04:48.106676 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=88550) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 19:04:48.107848 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=88551) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 19:04:48.108148 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `type` (API Prefix: ) [/roles, /roles/] {{(pid=88550) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 17 19:04:48.108442 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=88550) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 19:04:48.108738 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=88550) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 19:04:48.109942 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `type` (API Prefix: ) [/roles, /roles/] {{(pid=88551) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 17 19:04:48.110228 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=88551) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 19:04:48.110523 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=88551) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 19:04:48.115796 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=88550) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 19:04:48.117002 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=88551) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 19:04:48.117263 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `type` (API Prefix: ) [/services, /services/] {{(pid=88550) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 17 19:04:48.118484 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `type` (API Prefix: ) [/services, /services/] {{(pid=88551) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 17 19:04:48.120168 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=88550) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 19:04:48.120472 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=88550) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 19:04:48.120760 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=88550) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 19:04:48.121041 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=88550) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 19:04:48.121363 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=88551) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 19:04:48.121654 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=88551) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 19:04:48.121941 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=88551) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 19:04:48.122221 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=88551) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 19:04:48.130069 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `type` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=88550) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 17 19:04:48.130318 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `type` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=88551) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 17 19:04:48.130405 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=88550) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 19:04:48.130642 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=88551) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 19:04:48.130729 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=88550) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 19:04:48.130929 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=88551) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 19:04:48.137395 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `type` (API Prefix: ) [/users, /users/] {{(pid=88550) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 17 19:04:48.137625 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `type` (API Prefix: ) [/users, /users/] {{(pid=88551) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 17 19:04:48.137787 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=88550) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 19:04:48.138073 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=88550) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 19:04:48.138359 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=88550) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 19:04:48.138675 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=88550) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 19:04:48.138953 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=88550) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 19:04:48.139073 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=88551) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 19:04:48.139233 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=88550) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 19:04:48.139358 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=88551) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 19:04:48.139515 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=88550) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 19:04:48.139634 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=88551) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 19:04:48.139789 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=88550) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 19:04:48.139914 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=88551) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 19:04:48.140077 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=88550) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 19:04:48.140194 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=88551) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 19:04:48.140385 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=88550) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 19:04:48.140531 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=88551) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 19:04:48.140671 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=88550) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 19:04:48.140817 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=88551) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 19:04:48.140953 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=88550) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 19:04:48.141090 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=88551) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 19:04:48.141218 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=88550) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 19:04:48.141382 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=88551) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 19:04:48.141655 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=88551) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 19:04:48.141929 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=88551) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 19:04:48.142203 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=88551) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 19:04:48.142466 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=88551) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 19:04:48.175239 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x56508ab529c0 pid: 88550 (default app) Aug 17 19:04:48.176299 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x56508ab529c0 pid: 88551 (default app) Aug 17 19:04:48.178763 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f429a5-924e-4073-b13e-10c565a4640b None None] REQUEST_METHOD: `GET` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:04:48.179063 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f429a5-924e-4073-b13e-10c565a4640b None None] SCRIPT_NAME: `/identity` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:04:48.179340 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f429a5-924e-4073-b13e-10c565a4640b None None] PATH_INFO: `/v3` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:04:48.183772 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: [pid: 88550|app: 0|req: 1/1] 10.222.0.26 () {50 vars in 791 bytes} [Wed Aug 17 19:04:48 2022] GET /identity/v3/ => generated 255 bytes in 8 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 19:04:56.403517 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cddccfbd-3b2b-496a-8354-d8a339e09932 None None] REQUEST_METHOD: `GET` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:04:56.404117 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cddccfbd-3b2b-496a-8354-d8a339e09932 None None] SCRIPT_NAME: `/identity` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:04:56.404117 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cddccfbd-3b2b-496a-8354-d8a339e09932 None None] PATH_INFO: `/` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:04:56.408864 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: [pid: 88551|app: 0|req: 1/2] 10.222.0.26 () {54 vars in 927 bytes} [Wed Aug 17 19:04:56 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 19:04:56.414481 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea7fb2ef-a3dd-4644-97c7-532f92ad0c4b None None] REQUEST_METHOD: `POST` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:04:56.414996 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea7fb2ef-a3dd-4644-97c7-532f92ad0c4b None None] SCRIPT_NAME: `/identity` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:04:56.415084 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea7fb2ef-a3dd-4644-97c7-532f92ad0c4b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:04:56.493454 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: INFO dbcounter [None req-ea7fb2ef-a3dd-4644-97c7-532f92ad0c4b None None] Registered counter for database keystone Aug 17 19:04:56.512814 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG oslo_db.sqlalchemy.engines [None req-ea7fb2ef-a3dd-4644-97c7-532f92ad0c4b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=88550) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 17 19:04:56.519811 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG dbcounter [-] [88550] Writer thread running {{(pid=88550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 17 19:04:56.702172 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG passlib.handlers.bcrypt [None req-ea7fb2ef-a3dd-4644-97c7-532f92ad0c4b None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=88550) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Aug 17 19:04:56.702527 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG passlib.handlers.bcrypt [None req-ea7fb2ef-a3dd-4644-97c7-532f92ad0c4b None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=88550) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Aug 17 19:04:56.759147 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.auth.core [None req-ea7fb2ef-a3dd-4644-97c7-532f92ad0c4b None None] MFA Rules not processed for user `819d41a279e64291acc60de51e1530ae`. Rule list: `[]` (Enabled: `True`). {{(pid=88550) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 19:04:56.760760 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.common.fernet_utils [None req-ea7fb2ef-a3dd-4644-97c7-532f92ad0c4b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:04:56.895080 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: [pid: 88550|app: 0|req: 2/3] 10.222.0.26 () {58 vars in 1024 bytes} [Wed Aug 17 19:04:56 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 482 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Aug 17 19:04:57.410076 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cddccfbd-3b2b-496a-8354-d8a339e09932 None None] Authenticating user token {{(pid=88551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:04:57.489851 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: INFO dbcounter [None req-cddccfbd-3b2b-496a-8354-d8a339e09932 None None] Registered counter for database keystone Aug 17 19:04:57.512024 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG oslo_db.sqlalchemy.engines [None req-cddccfbd-3b2b-496a-8354-d8a339e09932 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=88551) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 17 19:04:57.518948 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG dbcounter [-] [88551] Writer thread running {{(pid=88551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 17 19:04:57.639232 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cddccfbd-3b2b-496a-8354-d8a339e09932 None None] Validating token access rules against request {{(pid=88551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:04:57.644239 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6da31b8-75aa-47cb-b8a5-84a7a87fcc36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '819d41a279e64291acc60de51e1530ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0490e0db9a14e81a7ea7b108a7ad6a0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:04:57.644877 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6da31b8-75aa-47cb-b8a5-84a7a87fcc36 admin admin] REQUEST_METHOD: `GET` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:04:57.645157 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6da31b8-75aa-47cb-b8a5-84a7a87fcc36 admin admin] SCRIPT_NAME: `/identity` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:04:57.645426 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6da31b8-75aa-47cb-b8a5-84a7a87fcc36 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:04:57.654415 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6da31b8-75aa-47cb-b8a5-84a7a87fcc36 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:04:57.706480 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: WARNING keystone.common.rbac_enforcer.enforcer [None req-b6da31b8-75aa-47cb-b8a5-84a7a87fcc36 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Aug 17 19:04:57.706768 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6da31b8-75aa-47cb-b8a5-84a7a87fcc36 admin admin] RBAC: Authorization granted {{(pid=88551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:04:57.717050 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: [pid: 88551|app: 0|req: 2/4] 10.222.0.26 () {58 vars in 1324 bytes} [Wed Aug 17 19:04:57 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Aug 17 19:04:57.723544 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea7fb2ef-a3dd-4644-97c7-532f92ad0c4b None None] Authenticating user token {{(pid=88550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:04:57.740909 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea7fb2ef-a3dd-4644-97c7-532f92ad0c4b None None] Validating token access rules against request {{(pid=88550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:04:57.745435 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd089990-6150-4182-beca-2d5316058325 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '819d41a279e64291acc60de51e1530ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0490e0db9a14e81a7ea7b108a7ad6a0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:04:57.746565 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd089990-6150-4182-beca-2d5316058325 admin admin] REQUEST_METHOD: `GET` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:04:57.746856 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd089990-6150-4182-beca-2d5316058325 admin admin] SCRIPT_NAME: `/identity` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:04:57.747137 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd089990-6150-4182-beca-2d5316058325 admin admin] PATH_INFO: `/v3/projects/d0490e0db9a14e81a7ea7b108a7ad6a0` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:04:57.748600 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd089990-6150-4182-beca-2d5316058325 admin admin] RBAC: Authorizing `identity:get_project(project_id=d0490e0db9a14e81a7ea7b108a7ad6a0)` {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:04:57.800725 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: WARNING keystone.common.rbac_enforcer.enforcer [None req-cd089990-6150-4182-beca-2d5316058325 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Aug 17 19:04:57.801070 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd089990-6150-4182-beca-2d5316058325 admin admin] RBAC: Authorization granted {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:04:57.805838 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: [pid: 88550|app: 0|req: 3/5] 10.222.0.26 () {56 vars in 1207 bytes} [Wed Aug 17 19:04:57 2022] GET /identity/v3/projects/d0490e0db9a14e81a7ea7b108a7ad6a0 => generated 344 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 19:04:59.997943 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f9a358-d352-4c6f-8e6d-de0c860f5165 None None] REQUEST_METHOD: `GET` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:04:59.998501 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f9a358-d352-4c6f-8e6d-de0c860f5165 None None] SCRIPT_NAME: `/identity` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:04:59.998501 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f9a358-d352-4c6f-8e6d-de0c860f5165 None None] PATH_INFO: `/` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:05:00.003540 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: [pid: 88551|app: 0|req: 3/6] 10.222.0.26 () {54 vars in 927 bytes} [Wed Aug 17 19:04:59 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 17 19:05:00.009087 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac48df7d-b8fb-4344-9ed3-ce0a16433177 None None] REQUEST_METHOD: `POST` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:05:00.009497 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac48df7d-b8fb-4344-9ed3-ce0a16433177 None None] SCRIPT_NAME: `/identity` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:05:00.009647 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac48df7d-b8fb-4344-9ed3-ce0a16433177 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:05:00.029958 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.auth.core [None req-ac48df7d-b8fb-4344-9ed3-ce0a16433177 None None] MFA Rules not processed for user `819d41a279e64291acc60de51e1530ae`. Rule list: `[]` (Enabled: `True`). {{(pid=88550) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 19:05:00.031565 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.common.fernet_utils [None req-ac48df7d-b8fb-4344-9ed3-ce0a16433177 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:05:00.039561 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: [pid: 88550|app: 0|req: 4/7] 10.222.0.26 () {58 vars in 1024 bytes} [Wed Aug 17 19:05:00 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Aug 17 19:05:00.373991 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69f9a358-d352-4c6f-8e6d-de0c860f5165 None None] Authenticating user token {{(pid=88551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:05:00.386292 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69f9a358-d352-4c6f-8e6d-de0c860f5165 None None] Validating token access rules against request {{(pid=88551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:05:00.391091 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02858ce8-95b3-47cc-9f50-4c125b1f7461 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '819d41a279e64291acc60de51e1530ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0490e0db9a14e81a7ea7b108a7ad6a0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:05:00.391682 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02858ce8-95b3-47cc-9f50-4c125b1f7461 admin admin] REQUEST_METHOD: `GET` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:05:00.391956 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02858ce8-95b3-47cc-9f50-4c125b1f7461 admin admin] SCRIPT_NAME: `/identity` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:05:00.392222 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02858ce8-95b3-47cc-9f50-4c125b1f7461 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:05:00.400377 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02858ce8-95b3-47cc-9f50-4c125b1f7461 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:05:00.402137 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02858ce8-95b3-47cc-9f50-4c125b1f7461 admin admin] RBAC: Authorization granted {{(pid=88551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:05:00.411818 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: [pid: 88551|app: 0|req: 4/8] 10.222.0.26 () {58 vars in 1324 bytes} [Wed Aug 17 19:05:00 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 17 19:05:00.418228 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac48df7d-b8fb-4344-9ed3-ce0a16433177 None None] Authenticating user token {{(pid=88550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:05:00.427881 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac48df7d-b8fb-4344-9ed3-ce0a16433177 None None] Validating token access rules against request {{(pid=88550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:05:00.432192 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e68d292f-89db-4849-be80-ac4402f1912a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '819d41a279e64291acc60de51e1530ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0490e0db9a14e81a7ea7b108a7ad6a0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:05:00.433111 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e68d292f-89db-4849-be80-ac4402f1912a admin admin] REQUEST_METHOD: `GET` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:05:00.433396 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e68d292f-89db-4849-be80-ac4402f1912a admin admin] SCRIPT_NAME: `/identity` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:05:00.433675 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e68d292f-89db-4849-be80-ac4402f1912a admin admin] PATH_INFO: `/v3/users/819d41a279e64291acc60de51e1530ae` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:05:00.435121 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e68d292f-89db-4849-be80-ac4402f1912a admin admin] RBAC: Authorizing `identity:get_user(user_id=819d41a279e64291acc60de51e1530ae)` {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:05:00.436970 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e68d292f-89db-4849-be80-ac4402f1912a admin admin] RBAC: Authorization granted {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:05:00.438631 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: [pid: 88550|app: 0|req: 5/9] 10.222.0.26 () {56 vars in 1198 bytes} [Wed Aug 17 19:05:00 2022] GET /identity/v3/users/819d41a279e64291acc60de51e1530ae => generated 247 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 19:05:02.728788 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3aaabc9-f274-4bec-8be9-eb5e6b89e1f3 None None] REQUEST_METHOD: `GET` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:05:02.729368 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3aaabc9-f274-4bec-8be9-eb5e6b89e1f3 None None] SCRIPT_NAME: `/identity` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:05:02.729454 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3aaabc9-f274-4bec-8be9-eb5e6b89e1f3 None None] PATH_INFO: `/` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:05:02.730814 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: [pid: 88551|app: 0|req: 5/10] 10.222.0.26 () {54 vars in 927 bytes} [Wed Aug 17 19:05:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 19:05:02.736268 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a77268cd-d8bf-403f-a67e-d180f6f149ed None None] REQUEST_METHOD: `POST` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:05:02.736713 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a77268cd-d8bf-403f-a67e-d180f6f149ed None None] SCRIPT_NAME: `/identity` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:05:02.739489 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a77268cd-d8bf-403f-a67e-d180f6f149ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:05:02.755420 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.auth.core [None req-a77268cd-d8bf-403f-a67e-d180f6f149ed None None] MFA Rules not processed for user `819d41a279e64291acc60de51e1530ae`. Rule list: `[]` (Enabled: `True`). {{(pid=88550) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 19:05:02.756649 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.common.fernet_utils [None req-a77268cd-d8bf-403f-a67e-d180f6f149ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:05:02.756969 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f32bd2-6529-45c3-a556-b54355c3ce76 None None] REQUEST_METHOD: `GET` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:05:02.757251 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f32bd2-6529-45c3-a556-b54355c3ce76 None None] SCRIPT_NAME: `/identity` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:05:02.757527 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f32bd2-6529-45c3-a556-b54355c3ce76 None None] PATH_INFO: `/` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:05:02.758918 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: [pid: 88551|app: 0|req: 6/11] 10.222.0.26 () {54 vars in 927 bytes} [Wed Aug 17 19:05:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 19:05:02.765095 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-318e6bb9-ce24-450e-a48f-61834c45c7b4 None None] REQUEST_METHOD: `POST` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:05:02.765877 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-318e6bb9-ce24-450e-a48f-61834c45c7b4 None None] SCRIPT_NAME: `/identity` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:05:02.766147 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-318e6bb9-ce24-450e-a48f-61834c45c7b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:05:02.809717 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG passlib.handlers.bcrypt [None req-318e6bb9-ce24-450e-a48f-61834c45c7b4 None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=88551) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Aug 17 19:05:02.810208 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG passlib.handlers.bcrypt [None req-318e6bb9-ce24-450e-a48f-61834c45c7b4 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=88551) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Aug 17 19:05:02.857272 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.auth.core [None req-318e6bb9-ce24-450e-a48f-61834c45c7b4 None None] MFA Rules not processed for user `819d41a279e64291acc60de51e1530ae`. Rule list: `[]` (Enabled: `True`). {{(pid=88551) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 19:05:02.858929 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.common.fernet_utils [None req-318e6bb9-ce24-450e-a48f-61834c45c7b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:05:02.956391 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: [pid: 88550|app: 0|req: 6/12] 10.222.0.26 () {58 vars in 1024 bytes} [Wed Aug 17 19:05:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 221 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 17 19:05:02.969166 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: [pid: 88551|app: 0|req: 7/13] 10.222.0.26 () {58 vars in 1024 bytes} [Wed Aug 17 19:05:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 205 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 17 19:05:03.284665 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a77268cd-d8bf-403f-a67e-d180f6f149ed None None] Authenticating user token {{(pid=88550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:05:03.290031 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-318e6bb9-ce24-450e-a48f-61834c45c7b4 None None] Authenticating user token {{(pid=88551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:05:03.309613 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG dbcounter [-] [88550] Writing DB stats keystone:SELECT=100 {{(pid=88550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:05:03.391390 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a77268cd-d8bf-403f-a67e-d180f6f149ed None None] Validating token access rules against request {{(pid=88550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:05:03.395573 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-318e6bb9-ce24-450e-a48f-61834c45c7b4 None None] Validating token access rules against request {{(pid=88551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:05:03.398073 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG dbcounter [-] [88551] Writing DB stats keystone:SELECT=100 {{(pid=88551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:05:03.427293 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caf55af6-71c0-4745-9e12-dd0840d2a69f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '819d41a279e64291acc60de51e1530ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:05:03.427939 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf55af6-71c0-4745-9e12-dd0840d2a69f None admin] REQUEST_METHOD: `GET` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:05:03.428222 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf55af6-71c0-4745-9e12-dd0840d2a69f None admin] SCRIPT_NAME: `/identity` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:05:03.428523 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf55af6-71c0-4745-9e12-dd0840d2a69f None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:05:03.436658 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e6c3a2d-4db1-47ca-a2f7-786ffec29bd8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '819d41a279e64291acc60de51e1530ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:05:03.438125 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e6c3a2d-4db1-47ca-a2f7-786ffec29bd8 None admin] REQUEST_METHOD: `GET` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:05:03.438413 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e6c3a2d-4db1-47ca-a2f7-786ffec29bd8 None admin] SCRIPT_NAME: `/identity` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:05:03.438717 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e6c3a2d-4db1-47ca-a2f7-786ffec29bd8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:05:03.441197 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caf55af6-71c0-4745-9e12-dd0840d2a69f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 17 19:05:03.450225 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application [None req-caf55af6-71c0-4745-9e12-dd0840d2a69f None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 17 19:05:03.450225 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 19:05:03.450225 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 19:05:03.450225 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 19:05:03.450225 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 19:05:03.450225 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 19:05:03.450225 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 19:05:03.450225 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 19:05:03.450225 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 19:05:03.450225 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 19:05:03.450225 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 19:05:03.450225 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 19:05:03.450225 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 17 19:05:03.450225 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 17 19:05:03.450225 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 17 19:05:03.450225 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 17 19:05:03.451382 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 17 19:05:03.451382 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 17 19:05:03.451382 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 17 19:05:03.451382 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 17 19:05:03.451382 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 19:05:03.451382 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 19:05:03.451382 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 19:05:03.451382 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 19:05:03.451382 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 19:05:03.451382 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 19:05:03.451382 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 19:05:03.451382 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application with Lock( Aug 17 19:05:03.451382 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 19:05:03.451382 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return self._enter() Aug 17 19:05:03.451382 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 19:05:03.451382 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 19:05:03.452510 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 19:05:03.452510 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return self.creator() Aug 17 19:05:03.452510 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 19:05:03.452510 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application created_value = creator( Aug 17 19:05:03.452510 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 17 19:05:03.452510 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 17 19:05:03.452510 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 17 19:05:03.452510 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 17 19:05:03.452510 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 17 19:05:03.452510 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 17 19:05:03.452510 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 17 19:05:03.452510 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application Aug 17 19:05:03.452510 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: [pid: 88550|app: 0|req: 7/14] 10.222.0.26 () {56 vars in 1096 bytes} [Wed Aug 17 19:05:03 2022] GET /identity/v3/roles/admin => generated 83 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 19:05:03.457317 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caf55af6-71c0-4745-9e12-dd0840d2a69f None admin] Authenticating user token {{(pid=88550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:05:03.516442 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e6c3a2d-4db1-47ca-a2f7-786ffec29bd8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:05:03.517964 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e6c3a2d-4db1-47ca-a2f7-786ffec29bd8 None admin] RBAC: Authorization granted {{(pid=88551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:05:03.540067 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG dbcounter [-] [88550] Writing DB stats keystone:SELECT=100 {{(pid=88550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:05:03.559220 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caf55af6-71c0-4745-9e12-dd0840d2a69f None admin] Validating token access rules against request {{(pid=88550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:05:03.594776 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93c24252-05e6-449d-a945-26c6459a913a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '819d41a279e64291acc60de51e1530ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:05:03.595523 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c24252-05e6-449d-a945-26c6459a913a None admin] REQUEST_METHOD: `GET` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:05:03.595914 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c24252-05e6-449d-a945-26c6459a913a None admin] SCRIPT_NAME: `/identity` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:05:03.596274 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c24252-05e6-449d-a945-26c6459a913a None admin] PATH_INFO: `/v3/roles` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:05:03.597198 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93c24252-05e6-449d-a945-26c6459a913a None admin] RBAC: Adding query filter params (name=admin) {{(pid=88550) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 19:05:03.597615 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93c24252-05e6-449d-a945-26c6459a913a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:05:03.599598 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93c24252-05e6-449d-a945-26c6459a913a None admin] RBAC: Authorization granted {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:05:03.616121 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: [pid: 88550|app: 0|req: 8/15] 10.222.0.26 () {56 vars in 1099 bytes} [Wed Aug 17 19:05:03 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 17 19:05:03.622028 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93c24252-05e6-449d-a945-26c6459a913a None admin] Authenticating user token {{(pid=88550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:05:03.629814 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: [pid: 88551|app: 0|req: 8/16] 10.222.0.26 () {58 vars in 1282 bytes} [Wed Aug 17 19:05:03 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 340 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 17 19:05:03.635411 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e6c3a2d-4db1-47ca-a2f7-786ffec29bd8 None admin] Authenticating user token {{(pid=88551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:05:03.638776 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG dbcounter [-] [88551] Writing DB stats keystone:SELECT=100 {{(pid=88551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:05:03.723973 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93c24252-05e6-449d-a945-26c6459a913a None admin] Validating token access rules against request {{(pid=88550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:05:03.737368 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e6c3a2d-4db1-47ca-a2f7-786ffec29bd8 None admin] Validating token access rules against request {{(pid=88551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:05:03.761882 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2db20f7-d400-45e5-8533-18b13bc9c899 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '819d41a279e64291acc60de51e1530ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:05:03.762520 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2db20f7-d400-45e5-8533-18b13bc9c899 None admin] REQUEST_METHOD: `GET` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:05:03.762834 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2db20f7-d400-45e5-8533-18b13bc9c899 None admin] SCRIPT_NAME: `/identity` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:05:03.763111 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2db20f7-d400-45e5-8533-18b13bc9c899 None admin] PATH_INFO: `/v3/users/819d41a279e64291acc60de51e1530ae` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:05:03.764276 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2db20f7-d400-45e5-8533-18b13bc9c899 None admin] RBAC: Authorizing `identity:get_user(user_id=819d41a279e64291acc60de51e1530ae)` {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:05:03.765796 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2db20f7-d400-45e5-8533-18b13bc9c899 None admin] RBAC: Authorization granted {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:05:03.767455 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: [pid: 88550|app: 0|req: 9/17] 10.222.0.26 () {56 vars in 1177 bytes} [Wed Aug 17 19:05:03 2022] GET /identity/v3/users/819d41a279e64291acc60de51e1530ae => generated 247 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 17 19:05:03.773146 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2db20f7-d400-45e5-8533-18b13bc9c899 None admin] Authenticating user token {{(pid=88550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:05:03.777289 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88679e02-ac88-4b89-9b43-a558ee8f4dc4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '819d41a279e64291acc60de51e1530ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:05:03.778160 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88679e02-ac88-4b89-9b43-a558ee8f4dc4 None admin] REQUEST_METHOD: `GET` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:05:03.778445 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88679e02-ac88-4b89-9b43-a558ee8f4dc4 None admin] SCRIPT_NAME: `/identity` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:05:03.778748 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88679e02-ac88-4b89-9b43-a558ee8f4dc4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:05:03.789083 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG dbcounter [-] [88550] Writing DB stats keystone:SELECT=100 {{(pid=88550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:05:03.799693 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88679e02-ac88-4b89-9b43-a558ee8f4dc4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:05:03.801189 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88679e02-ac88-4b89-9b43-a558ee8f4dc4 None admin] RBAC: Authorization granted {{(pid=88551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:05:03.820433 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application [None req-88679e02-ac88-4b89-9b43-a558ee8f4dc4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 19:05:03.820433 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 19:05:03.820433 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 19:05:03.820433 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 19:05:03.820433 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 19:05:03.820433 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 19:05:03.820433 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 19:05:03.820433 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 19:05:03.820433 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 19:05:03.820433 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 19:05:03.820433 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 19:05:03.820433 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 19:05:03.820433 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 17 19:05:03.820433 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 17 19:05:03.820433 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 17 19:05:03.820433 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 17 19:05:03.821585 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 19:05:03.821585 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 19:05:03.821585 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 19:05:03.821585 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 19:05:03.821585 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 19:05:03.821585 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 19:05:03.821585 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 19:05:03.821585 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application with Lock( Aug 17 19:05:03.821585 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 19:05:03.821585 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application return self._enter() Aug 17 19:05:03.821585 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 19:05:03.821585 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 19:05:03.821585 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 19:05:03.821585 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application return self.creator() Aug 17 19:05:03.821585 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 19:05:03.821585 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application created_value = creator( Aug 17 19:05:03.821585 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 17 19:05:03.822639 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 17 19:05:03.822639 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 19:05:03.822639 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application Aug 17 19:05:03.822639 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: [pid: 88551|app: 0|req: 9/18] 10.222.0.26 () {56 vars in 1108 bytes} [Wed Aug 17 19:05:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 17 19:05:03.828594 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88679e02-ac88-4b89-9b43-a558ee8f4dc4 None admin] Authenticating user token {{(pid=88551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:05:03.882667 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2db20f7-d400-45e5-8533-18b13bc9c899 None admin] Validating token access rules against request {{(pid=88550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:05:03.886864 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG dbcounter [-] [88551] Writing DB stats keystone:SELECT=100 {{(pid=88551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:05:03.919303 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6917d4e6-ba27-49b5-9287-fd4bde396a2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '819d41a279e64291acc60de51e1530ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:05:03.919969 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6917d4e6-ba27-49b5-9287-fd4bde396a2d None admin] REQUEST_METHOD: `GET` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:05:03.920291 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6917d4e6-ba27-49b5-9287-fd4bde396a2d None admin] SCRIPT_NAME: `/identity` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:05:03.920607 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6917d4e6-ba27-49b5-9287-fd4bde396a2d None admin] PATH_INFO: `/v3/domains/default` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:05:03.922461 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6917d4e6-ba27-49b5-9287-fd4bde396a2d None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:05:03.924089 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6917d4e6-ba27-49b5-9287-fd4bde396a2d None admin] RBAC: Authorization granted {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:05:03.925919 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: [pid: 88550|app: 0|req: 10/19] 10.222.0.26 () {56 vars in 1108 bytes} [Wed Aug 17 19:05:03 2022] GET /identity/v3/domains/default => generated 199 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 17 19:05:03.932400 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6917d4e6-ba27-49b5-9287-fd4bde396a2d None admin] Authenticating user token {{(pid=88550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:05:04.024606 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG dbcounter [-] [88550] Writing DB stats keystone:SELECT=100 {{(pid=88550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:05:04.045163 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6917d4e6-ba27-49b5-9287-fd4bde396a2d None admin] Validating token access rules against request {{(pid=88550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:05:04.045953 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88679e02-ac88-4b89-9b43-a558ee8f4dc4 None admin] Validating token access rules against request {{(pid=88551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:05:04.080643 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7d45e58-91b3-4ea5-953e-87d48c80a0fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '819d41a279e64291acc60de51e1530ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:05:04.080894 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c92f8d4-1c00-42a1-acab-a2e045d01ead None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '819d41a279e64291acc60de51e1530ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:05:04.081181 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d45e58-91b3-4ea5-953e-87d48c80a0fb None admin] REQUEST_METHOD: `GET` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:05:04.081463 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d45e58-91b3-4ea5-953e-87d48c80a0fb None admin] SCRIPT_NAME: `/identity` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:05:04.081550 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c92f8d4-1c00-42a1-acab-a2e045d01ead None admin] REQUEST_METHOD: `GET` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:05:04.081736 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d45e58-91b3-4ea5-953e-87d48c80a0fb None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:05:04.081824 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c92f8d4-1c00-42a1-acab-a2e045d01ead None admin] SCRIPT_NAME: `/identity` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:05:04.082019 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c92f8d4-1c00-42a1-acab-a2e045d01ead None admin] PATH_INFO: `/v3/domains` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:05:04.082461 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7d45e58-91b3-4ea5-953e-87d48c80a0fb None admin] RBAC: Adding query filter params (role.id=204f62ae18174b60a2e3f5d4f28ea326, scope.domain.id=default, user.id=819d41a279e64291acc60de51e1530ae) {{(pid=88550) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 19:05:04.082704 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c92f8d4-1c00-42a1-acab-a2e045d01ead None admin] RBAC: Adding query filter params (name=Default) {{(pid=88551) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 19:05:04.082810 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7d45e58-91b3-4ea5-953e-87d48c80a0fb None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:05:04.083011 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c92f8d4-1c00-42a1-acab-a2e045d01ead None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:05:04.084225 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7d45e58-91b3-4ea5-953e-87d48c80a0fb None admin] RBAC: Authorization granted {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:05:04.084378 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c92f8d4-1c00-42a1-acab-a2e045d01ead None admin] RBAC: Authorization granted {{(pid=88551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:05:04.091277 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: [pid: 88550|app: 0|req: 11/20] 10.222.0.26 () {56 vars in 1322 bytes} [Wed Aug 17 19:05:03 2022] GET /identity/v3/role_assignments?user.id=819d41a279e64291acc60de51e1530ae&scope.domain.id=default&role.id=204f62ae18174b60a2e3f5d4f28ea326 => generated 233 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 19:05:04.106193 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: [pid: 88551|app: 0|req: 10/21] 10.222.0.26 () {56 vars in 1109 bytes} [Wed Aug 17 19:05:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 279 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 17 19:05:06.578458 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47037408-dd7e-4548-b6c2-52d982bb7bf7 None None] REQUEST_METHOD: `GET` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:05:06.579060 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47037408-dd7e-4548-b6c2-52d982bb7bf7 None None] SCRIPT_NAME: `/identity` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:05:06.579060 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47037408-dd7e-4548-b6c2-52d982bb7bf7 None None] PATH_INFO: `/` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:05:06.580727 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: [pid: 88550|app: 0|req: 12/22] 10.222.0.26 () {54 vars in 927 bytes} [Wed Aug 17 19:05:06 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 19:05:06.586593 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6fc096d-4d31-496b-b8f4-9cee3d2865eb None None] REQUEST_METHOD: `POST` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:05:06.587123 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6fc096d-4d31-496b-b8f4-9cee3d2865eb None None] SCRIPT_NAME: `/identity` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:05:06.587364 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6fc096d-4d31-496b-b8f4-9cee3d2865eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:05:06.615664 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.auth.core [None req-a6fc096d-4d31-496b-b8f4-9cee3d2865eb None None] MFA Rules not processed for user `819d41a279e64291acc60de51e1530ae`. Rule list: `[]` (Enabled: `True`). {{(pid=88551) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 19:05:06.617978 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.common.fernet_utils [None req-a6fc096d-4d31-496b-b8f4-9cee3d2865eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:05:06.717845 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: [pid: 88551|app: 0|req: 11/23] 10.222.0.26 () {58 vars in 1024 bytes} [Wed Aug 17 19:05:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 17 19:05:06.766455 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b60d83c2-5d44-4771-a286-bfbe3bb42590 None None] REQUEST_METHOD: `GET` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:05:06.766802 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b60d83c2-5d44-4771-a286-bfbe3bb42590 None None] SCRIPT_NAME: `/identity` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:05:06.767058 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b60d83c2-5d44-4771-a286-bfbe3bb42590 None None] PATH_INFO: `/` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:05:06.768402 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: [pid: 88550|app: 0|req: 13/24] 10.222.0.26 () {54 vars in 927 bytes} [Wed Aug 17 19:05:06 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 19:05:06.773939 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-904c4430-ac0a-4b3a-925f-109adaae3974 None None] REQUEST_METHOD: `POST` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:05:06.774232 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-904c4430-ac0a-4b3a-925f-109adaae3974 None None] SCRIPT_NAME: `/identity` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:05:06.774513 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-904c4430-ac0a-4b3a-925f-109adaae3974 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:05:06.801822 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.auth.core [None req-904c4430-ac0a-4b3a-925f-109adaae3974 None None] MFA Rules not processed for user `819d41a279e64291acc60de51e1530ae`. Rule list: `[]` (Enabled: `True`). {{(pid=88551) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 19:05:06.803078 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.common.fernet_utils [None req-904c4430-ac0a-4b3a-925f-109adaae3974 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:05:06.868003 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG dbcounter [-] [88551] Writing DB stats keystone:SELECT=100 {{(pid=88551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:05:06.903912 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: [pid: 88551|app: 0|req: 12/25] 10.222.0.26 () {58 vars in 1024 bytes} [Wed Aug 17 19:05:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 17 19:05:06.955112 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f60dd0-b02d-4a9a-879b-a0be4ad766e8 None None] REQUEST_METHOD: `GET` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:05:06.955410 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f60dd0-b02d-4a9a-879b-a0be4ad766e8 None None] SCRIPT_NAME: `/identity` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:05:06.955688 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f60dd0-b02d-4a9a-879b-a0be4ad766e8 None None] PATH_INFO: `/` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:05:06.957221 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: [pid: 88550|app: 0|req: 14/26] 10.222.0.26 () {54 vars in 927 bytes} [Wed Aug 17 19:05:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 19:05:06.964138 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f368c7d0-ee16-4933-87cb-786f91272f27 None None] REQUEST_METHOD: `POST` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:05:06.964418 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f368c7d0-ee16-4933-87cb-786f91272f27 None None] SCRIPT_NAME: `/identity` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:05:06.964705 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f368c7d0-ee16-4933-87cb-786f91272f27 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:05:06.991871 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.auth.core [None req-f368c7d0-ee16-4933-87cb-786f91272f27 None None] MFA Rules not processed for user `819d41a279e64291acc60de51e1530ae`. Rule list: `[]` (Enabled: `True`). {{(pid=88551) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 19:05:06.993168 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.common.fernet_utils [None req-f368c7d0-ee16-4933-87cb-786f91272f27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:05:07.092905 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: [pid: 88551|app: 0|req: 13/27] 10.222.0.26 () {58 vars in 1024 bytes} [Wed Aug 17 19:05:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 17 19:05:07.300610 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45f60dd0-b02d-4a9a-879b-a0be4ad766e8 None None] Authenticating user token {{(pid=88550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:05:07.431238 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45f60dd0-b02d-4a9a-879b-a0be4ad766e8 None None] Validating token access rules against request {{(pid=88550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:05:07.439229 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f368c7d0-ee16-4933-87cb-786f91272f27 None None] Authenticating user token {{(pid=88551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:05:07.501034 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9065c017-ceb4-4582-98f2-dbd9b7b59ea3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '819d41a279e64291acc60de51e1530ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:05:07.502036 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9065c017-ceb4-4582-98f2-dbd9b7b59ea3 None admin] REQUEST_METHOD: `GET` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:05:07.502531 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9065c017-ceb4-4582-98f2-dbd9b7b59ea3 None admin] SCRIPT_NAME: `/identity` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:05:07.503032 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9065c017-ceb4-4582-98f2-dbd9b7b59ea3 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:05:07.522412 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9065c017-ceb4-4582-98f2-dbd9b7b59ea3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 17 19:05:07.527721 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application [None req-9065c017-ceb4-4582-98f2-dbd9b7b59ea3 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 17 19:05:07.527721 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 19:05:07.527721 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 19:05:07.527721 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 19:05:07.527721 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 19:05:07.527721 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 19:05:07.527721 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 19:05:07.527721 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 19:05:07.527721 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 19:05:07.527721 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 19:05:07.527721 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 19:05:07.527721 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 19:05:07.527721 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 17 19:05:07.527721 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 17 19:05:07.527721 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 17 19:05:07.527721 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 17 19:05:07.528587 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 17 19:05:07.528587 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 17 19:05:07.528587 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 17 19:05:07.528587 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 17 19:05:07.528587 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 19:05:07.528587 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 19:05:07.528587 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 19:05:07.528587 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 19:05:07.528587 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 19:05:07.528587 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 19:05:07.528587 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 19:05:07.528587 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application with Lock( Aug 17 19:05:07.528587 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 19:05:07.528587 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return self._enter() Aug 17 19:05:07.528587 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 19:05:07.528587 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 19:05:07.529361 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 19:05:07.529361 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return self.creator() Aug 17 19:05:07.529361 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 19:05:07.529361 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application created_value = creator( Aug 17 19:05:07.529361 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 17 19:05:07.529361 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 17 19:05:07.529361 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 17 19:05:07.529361 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 17 19:05:07.529361 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 17 19:05:07.529361 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 17 19:05:07.529361 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 17 19:05:07.529361 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application Aug 17 19:05:07.539217 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: [pid: 88550|app: 0|req: 15/28] 10.222.0.26 () {56 vars in 1096 bytes} [Wed Aug 17 19:05:07 2022] GET /identity/v3/roles/admin => generated 83 bytes in 239 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 19:05:07.545682 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9065c017-ceb4-4582-98f2-dbd9b7b59ea3 None admin] Authenticating user token {{(pid=88550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:05:07.559009 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG dbcounter [-] [88550] Writing DB stats keystone:SELECT=100 {{(pid=88550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:05:07.657281 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f368c7d0-ee16-4933-87cb-786f91272f27 None None] Validating token access rules against request {{(pid=88551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:05:07.674718 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG dbcounter [-] [88551] Writing DB stats keystone:SELECT=100 {{(pid=88551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:05:07.702295 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9065c017-ceb4-4582-98f2-dbd9b7b59ea3 None admin] Validating token access rules against request {{(pid=88550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:05:07.716971 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad167102-90be-4f3e-8902-1bf1e93955c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '819d41a279e64291acc60de51e1530ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:05:07.717727 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad167102-90be-4f3e-8902-1bf1e93955c8 None admin] REQUEST_METHOD: `GET` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:05:07.718015 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad167102-90be-4f3e-8902-1bf1e93955c8 None admin] SCRIPT_NAME: `/identity` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:05:07.718816 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad167102-90be-4f3e-8902-1bf1e93955c8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:05:07.740388 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad167102-90be-4f3e-8902-1bf1e93955c8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:05:07.741907 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad167102-90be-4f3e-8902-1bf1e93955c8 None admin] RBAC: Authorization granted {{(pid=88551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:05:07.745568 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc24fb9d-45e9-4b47-9aa8-e689634d5282 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '819d41a279e64291acc60de51e1530ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:05:07.746199 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc24fb9d-45e9-4b47-9aa8-e689634d5282 None admin] REQUEST_METHOD: `GET` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:05:07.746481 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc24fb9d-45e9-4b47-9aa8-e689634d5282 None admin] SCRIPT_NAME: `/identity` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:05:07.746791 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc24fb9d-45e9-4b47-9aa8-e689634d5282 None admin] PATH_INFO: `/v3/roles` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:05:07.748354 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc24fb9d-45e9-4b47-9aa8-e689634d5282 None admin] RBAC: Adding query filter params (name=admin) {{(pid=88550) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 19:05:07.748668 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc24fb9d-45e9-4b47-9aa8-e689634d5282 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:05:07.750179 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc24fb9d-45e9-4b47-9aa8-e689634d5282 None admin] RBAC: Authorization granted {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:05:07.766439 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: [pid: 88550|app: 0|req: 16/29] 10.222.0.26 () {56 vars in 1099 bytes} [Wed Aug 17 19:05:07 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 17 19:05:07.767168 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc24fb9d-45e9-4b47-9aa8-e689634d5282 None admin] Authenticating user token {{(pid=88550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:05:07.773306 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application [None req-ad167102-90be-4f3e-8902-1bf1e93955c8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 19:05:07.773306 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 19:05:07.773306 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 19:05:07.773306 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 19:05:07.773306 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 19:05:07.773306 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 19:05:07.773306 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 19:05:07.773306 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 19:05:07.773306 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 19:05:07.773306 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 19:05:07.773306 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 19:05:07.773306 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 19:05:07.773306 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 17 19:05:07.773306 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 17 19:05:07.773306 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 17 19:05:07.773306 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 17 19:05:07.774193 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 19:05:07.774193 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 19:05:07.774193 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 19:05:07.774193 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 19:05:07.774193 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 19:05:07.774193 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 19:05:07.774193 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 19:05:07.774193 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application with Lock( Aug 17 19:05:07.774193 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 19:05:07.774193 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application return self._enter() Aug 17 19:05:07.774193 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 19:05:07.774193 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 19:05:07.774193 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 19:05:07.774193 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application return self.creator() Aug 17 19:05:07.774193 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 19:05:07.774193 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application created_value = creator( Aug 17 19:05:07.774193 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 17 19:05:07.775043 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 17 19:05:07.775043 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 19:05:07.775043 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application Aug 17 19:05:07.775043 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: [pid: 88551|app: 0|req: 14/30] 10.222.0.26 () {56 vars in 1108 bytes} [Wed Aug 17 19:05:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 336 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 17 19:05:07.775652 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad167102-90be-4f3e-8902-1bf1e93955c8 None admin] Authenticating user token {{(pid=88551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:05:07.912711 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG dbcounter [-] [88550] Writing DB stats keystone:SELECT=100 {{(pid=88550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:05:07.996221 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad167102-90be-4f3e-8902-1bf1e93955c8 None admin] Validating token access rules against request {{(pid=88551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:05:08.008733 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc24fb9d-45e9-4b47-9aa8-e689634d5282 None admin] Validating token access rules against request {{(pid=88550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:05:08.034015 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d621742-cfcb-4bb3-abc3-eccaf26398a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '819d41a279e64291acc60de51e1530ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:05:08.034738 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d621742-cfcb-4bb3-abc3-eccaf26398a1 None admin] REQUEST_METHOD: `GET` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:05:08.035020 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d621742-cfcb-4bb3-abc3-eccaf26398a1 None admin] SCRIPT_NAME: `/identity` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:05:08.035292 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d621742-cfcb-4bb3-abc3-eccaf26398a1 None admin] PATH_INFO: `/v3/users/819d41a279e64291acc60de51e1530ae` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:05:08.036755 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d621742-cfcb-4bb3-abc3-eccaf26398a1 None admin] RBAC: Authorizing `identity:get_user(user_id=819d41a279e64291acc60de51e1530ae)` {{(pid=88551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:05:08.038570 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d621742-cfcb-4bb3-abc3-eccaf26398a1 None admin] RBAC: Authorization granted {{(pid=88551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:05:08.041374 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: [pid: 88551|app: 0|req: 15/31] 10.222.0.26 () {56 vars in 1177 bytes} [Wed Aug 17 19:05:07 2022] GET /identity/v3/users/819d41a279e64291acc60de51e1530ae => generated 247 bytes in 265 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 19:05:08.041374 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d621742-cfcb-4bb3-abc3-eccaf26398a1 None admin] Authenticating user token {{(pid=88551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:05:08.068966 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64dc34ba-bee3-46b9-90da-4f4fe2795809 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '819d41a279e64291acc60de51e1530ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:05:08.069729 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64dc34ba-bee3-46b9-90da-4f4fe2795809 None admin] REQUEST_METHOD: `POST` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:05:08.070354 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64dc34ba-bee3-46b9-90da-4f4fe2795809 None admin] SCRIPT_NAME: `/identity` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:05:08.070669 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64dc34ba-bee3-46b9-90da-4f4fe2795809 None admin] PATH_INFO: `/v3/roles` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:05:08.071630 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64dc34ba-bee3-46b9-90da-4f4fe2795809 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:05:08.072416 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG dbcounter [-] [88551] Writing DB stats keystone:SELECT=100 {{(pid=88551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:05:08.073190 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64dc34ba-bee3-46b9-90da-4f4fe2795809 None admin] RBAC: Authorization granted {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:05:08.152402 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d621742-cfcb-4bb3-abc3-eccaf26398a1 None admin] Validating token access rules against request {{(pid=88551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:05:08.208807 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2255219b-5340-4ca6-8e31-78c645118e28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '819d41a279e64291acc60de51e1530ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:05:08.209821 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2255219b-5340-4ca6-8e31-78c645118e28 None admin] REQUEST_METHOD: `GET` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:05:08.210452 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2255219b-5340-4ca6-8e31-78c645118e28 None admin] SCRIPT_NAME: `/identity` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:05:08.211003 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2255219b-5340-4ca6-8e31-78c645118e28 None admin] PATH_INFO: `/v3/domains` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:05:08.211891 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2255219b-5340-4ca6-8e31-78c645118e28 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88551) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 19:05:08.212447 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2255219b-5340-4ca6-8e31-78c645118e28 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:05:08.214205 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2255219b-5340-4ca6-8e31-78c645118e28 None admin] RBAC: Authorization granted {{(pid=88551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:05:08.229556 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: [pid: 88551|app: 0|req: 16/32] 10.222.0.26 () {56 vars in 1109 bytes} [Wed Aug 17 19:05:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 19:05:08.230854 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2255219b-5340-4ca6-8e31-78c645118e28 None admin] Authenticating user token {{(pid=88551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:05:08.322561 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: [pid: 88550|app: 0|req: 17/33] 10.222.0.26 () {60 vars in 1131 bytes} [Wed Aug 17 19:05:07 2022] POST /identity/v3/roles => generated 219 bytes in 551 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 19:05:08.322561 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-526965aa-9f39-42cf-a43c-18ef0f0f420e None None] REQUEST_METHOD: `GET` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:05:08.322561 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-526965aa-9f39-42cf-a43c-18ef0f0f420e None None] SCRIPT_NAME: `/identity` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:05:08.322561 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-526965aa-9f39-42cf-a43c-18ef0f0f420e None None] PATH_INFO: `/` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:05:08.322561 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: [pid: 88550|app: 0|req: 18/34] 10.222.0.26 () {54 vars in 927 bytes} [Wed Aug 17 19:05:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 19:05:08.322561 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-526965aa-9f39-42cf-a43c-18ef0f0f420e None None] Authenticating user token {{(pid=88550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:05:08.341343 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG dbcounter [-] [88551] Writing DB stats keystone:SELECT=100 {{(pid=88551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:05:08.364682 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2255219b-5340-4ca6-8e31-78c645118e28 None admin] Validating token access rules against request {{(pid=88551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:05:08.404017 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01474f2f-9074-447e-8015-c16e0dd66792 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '819d41a279e64291acc60de51e1530ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:05:08.404666 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01474f2f-9074-447e-8015-c16e0dd66792 None admin] REQUEST_METHOD: `GET` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:05:08.404949 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01474f2f-9074-447e-8015-c16e0dd66792 None admin] SCRIPT_NAME: `/identity` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:05:08.405236 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01474f2f-9074-447e-8015-c16e0dd66792 None admin] PATH_INFO: `/v3/domains/default` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:05:08.406446 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01474f2f-9074-447e-8015-c16e0dd66792 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=88551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:05:08.407958 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01474f2f-9074-447e-8015-c16e0dd66792 None admin] RBAC: Authorization granted {{(pid=88551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:05:08.414289 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: [pid: 88551|app: 0|req: 17/35] 10.222.0.26 () {56 vars in 1108 bytes} [Wed Aug 17 19:05:08 2022] GET /identity/v3/domains/default => generated 199 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 19:05:08.414289 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c6f3ac-77c5-46c2-8f81-5c7947a28e89 None None] REQUEST_METHOD: `GET` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:05:08.414289 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c6f3ac-77c5-46c2-8f81-5c7947a28e89 None None] SCRIPT_NAME: `/identity` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:05:08.414289 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c6f3ac-77c5-46c2-8f81-5c7947a28e89 None None] PATH_INFO: `/` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:05:08.414289 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: [pid: 88551|app: 0|req: 18/36] 10.222.0.26 () {54 vars in 927 bytes} [Wed Aug 17 19:05:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 19:05:08.414289 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1769660a-5e30-4b82-a365-5554b8b5f079 None None] REQUEST_METHOD: `POST` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:05:08.414289 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1769660a-5e30-4b82-a365-5554b8b5f079 None None] SCRIPT_NAME: `/identity` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:05:08.415105 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1769660a-5e30-4b82-a365-5554b8b5f079 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:05:08.434184 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.auth.core [None req-1769660a-5e30-4b82-a365-5554b8b5f079 None None] MFA Rules not processed for user `819d41a279e64291acc60de51e1530ae`. Rule list: `[]` (Enabled: `True`). {{(pid=88551) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 19:05:08.435441 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.common.fernet_utils [None req-1769660a-5e30-4b82-a365-5554b8b5f079 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:05:08.461950 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-526965aa-9f39-42cf-a43c-18ef0f0f420e None None] Validating token access rules against request {{(pid=88550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:05:08.494325 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG dbcounter [-] [88550] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:05:08.506029 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc09a206-6936-4e2f-835f-f4eb4c079b38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '819d41a279e64291acc60de51e1530ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:05:08.506671 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc09a206-6936-4e2f-835f-f4eb4c079b38 None admin] REQUEST_METHOD: `POST` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:05:08.507719 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc09a206-6936-4e2f-835f-f4eb4c079b38 None admin] SCRIPT_NAME: `/identity` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:05:08.507719 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc09a206-6936-4e2f-835f-f4eb4c079b38 None admin] PATH_INFO: `/v3/projects` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:05:08.507891 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc09a206-6936-4e2f-835f-f4eb4c079b38 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:05:08.509420 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc09a206-6936-4e2f-835f-f4eb4c079b38 None admin] RBAC: Authorization granted {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:05:08.520469 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: [pid: 88551|app: 0|req: 19/37] 10.222.0.26 () {58 vars in 1024 bytes} [Wed Aug 17 19:05:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 17 19:05:08.522081 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22440091-13dd-424a-8e26-d1ba7d8b73be None None] REQUEST_METHOD: `GET` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:05:08.522607 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22440091-13dd-424a-8e26-d1ba7d8b73be None None] SCRIPT_NAME: `/identity` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:05:08.523035 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22440091-13dd-424a-8e26-d1ba7d8b73be None None] PATH_INFO: `/` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:05:08.524750 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: [pid: 88551|app: 0|req: 20/38] 10.222.0.26 () {54 vars in 927 bytes} [Wed Aug 17 19:05:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 19:05:08.525601 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22440091-13dd-424a-8e26-d1ba7d8b73be None None] Authenticating user token {{(pid=88551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:05:08.624130 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: [pid: 88550|app: 0|req: 19/39] 10.222.0.26 () {60 vars in 1141 bytes} [Wed Aug 17 19:05:08 2022] POST /identity/v3/projects => generated 301 bytes in 302 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 19:05:08.625994 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c63bb1e-f1b4-4b60-9346-6de0a0981f39 None None] REQUEST_METHOD: `POST` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:05:08.626318 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c63bb1e-f1b4-4b60-9346-6de0a0981f39 None None] SCRIPT_NAME: `/identity` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:05:08.626631 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c63bb1e-f1b4-4b60-9346-6de0a0981f39 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:05:08.630907 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG dbcounter [-] [88551] Writing DB stats keystone:SELECT=100 {{(pid=88551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:05:08.647485 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.auth.core [None req-7c63bb1e-f1b4-4b60-9346-6de0a0981f39 None None] MFA Rules not processed for user `819d41a279e64291acc60de51e1530ae`. Rule list: `[]` (Enabled: `True`). {{(pid=88550) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 19:05:08.649140 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.common.fernet_utils [None req-7c63bb1e-f1b4-4b60-9346-6de0a0981f39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:05:08.657388 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22440091-13dd-424a-8e26-d1ba7d8b73be None None] Validating token access rules against request {{(pid=88551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:05:08.704260 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bd0bfad-c34e-43d2-a7d7-00778b629e2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '819d41a279e64291acc60de51e1530ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:05:08.704944 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd0bfad-c34e-43d2-a7d7-00778b629e2f None admin] REQUEST_METHOD: `PUT` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:05:08.705241 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd0bfad-c34e-43d2-a7d7-00778b629e2f None admin] SCRIPT_NAME: `/identity` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:05:08.705515 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd0bfad-c34e-43d2-a7d7-00778b629e2f None admin] PATH_INFO: `/v3/domains/default/users/819d41a279e64291acc60de51e1530ae/roles/204f62ae18174b60a2e3f5d4f28ea326` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:05:08.707710 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bd0bfad-c34e-43d2-a7d7-00778b629e2f None admin] RBAC: Authorizing `identity:create_grant(domain_id=default, user_id=819d41a279e64291acc60de51e1530ae, role_id=204f62ae18174b60a2e3f5d4f28ea326)` {{(pid=88551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:05:08.709259 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bd0bfad-c34e-43d2-a7d7-00778b629e2f None admin] RBAC: Authorization granted {{(pid=88551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:05:08.732131 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: [pid: 88550|app: 0|req: 20/40] 10.222.0.26 () {58 vars in 1024 bytes} [Wed Aug 17 19:05:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 17 19:05:08.733420 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7880ea0-c485-4c4e-900a-46d522e93d28 None None] REQUEST_METHOD: `POST` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:05:08.733706 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7880ea0-c485-4c4e-900a-46d522e93d28 None None] SCRIPT_NAME: `/identity` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:05:08.734503 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7880ea0-c485-4c4e-900a-46d522e93d28 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:05:08.755654 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.auth.core [None req-b7880ea0-c485-4c4e-900a-46d522e93d28 None None] MFA Rules not processed for user `819d41a279e64291acc60de51e1530ae`. Rule list: `[]` (Enabled: `True`). {{(pid=88550) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 19:05:08.756962 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.common.fernet_utils [None req-b7880ea0-c485-4c4e-900a-46d522e93d28 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:05:08.856420 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: [pid: 88550|app: 0|req: 21/41] 10.222.0.26 () {58 vars in 1024 bytes} [Wed Aug 17 19:05:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 17 19:05:08.861461 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7880ea0-c485-4c4e-900a-46d522e93d28 None None] Authenticating user token {{(pid=88550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:05:08.906971 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG dbcounter [-] [88550] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:05:08.933261 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: [pid: 88551|app: 0|req: 21/42] 10.222.0.26 () {58 vars in 1361 bytes} [Wed Aug 17 19:05:08 2022] PUT /identity/v3/domains/default/users/819d41a279e64291acc60de51e1530ae/roles/204f62ae18174b60a2e3f5d4f28ea326 => generated 0 bytes in 408 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 19:05:08.981764 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7880ea0-c485-4c4e-900a-46d522e93d28 None None] Validating token access rules against request {{(pid=88550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:05:09.022695 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ef9396f-c773-4917-a320-752d61e9356c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '819d41a279e64291acc60de51e1530ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:05:09.023251 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef9396f-c773-4917-a320-752d61e9356c None admin] REQUEST_METHOD: `POST` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:05:09.025297 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef9396f-c773-4917-a320-752d61e9356c None admin] SCRIPT_NAME: `/identity` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:05:09.025297 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef9396f-c773-4917-a320-752d61e9356c None admin] PATH_INFO: `/v3/roles` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:05:09.025297 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ef9396f-c773-4917-a320-752d61e9356c None admin] RBAC: Authorizing `identity:create_role()` {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:05:09.025973 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ef9396f-c773-4917-a320-752d61e9356c None admin] RBAC: Authorization granted {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:05:09.088663 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: [pid: 88550|app: 0|req: 22/43] 10.222.0.26 () {60 vars in 1131 bytes} [Wed Aug 17 19:05:08 2022] POST /identity/v3/roles => generated 225 bytes in 227 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 17 19:05:09.157325 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bd0bfad-c34e-43d2-a7d7-00778b629e2f None admin] Authenticating user token {{(pid=88551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:05:09.243295 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ef9396f-c773-4917-a320-752d61e9356c None admin] Authenticating user token {{(pid=88550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:05:09.275462 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bd0bfad-c34e-43d2-a7d7-00778b629e2f None admin] Validating token access rules against request {{(pid=88551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:05:09.321033 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40f0dde3-7461-4ba8-a234-5d220922d4c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '819d41a279e64291acc60de51e1530ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:05:09.322348 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f0dde3-7461-4ba8-a234-5d220922d4c8 None admin] REQUEST_METHOD: `GET` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:05:09.322847 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f0dde3-7461-4ba8-a234-5d220922d4c8 None admin] SCRIPT_NAME: `/identity` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:05:09.323458 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f0dde3-7461-4ba8-a234-5d220922d4c8 None admin] PATH_INFO: `/v3/domains/default` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:05:09.325798 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40f0dde3-7461-4ba8-a234-5d220922d4c8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=88551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:05:09.328969 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40f0dde3-7461-4ba8-a234-5d220922d4c8 None admin] RBAC: Authorization granted {{(pid=88551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:05:09.335038 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: [pid: 88551|app: 0|req: 22/44] 10.222.0.26 () {56 vars in 1108 bytes} [Wed Aug 17 19:05:09 2022] GET /identity/v3/domains/default => generated 199 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 19:05:09.341010 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40f0dde3-7461-4ba8-a234-5d220922d4c8 None admin] Authenticating user token {{(pid=88551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:05:09.359165 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG dbcounter [-] [88551] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:05:09.374102 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG dbcounter [-] [88550] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:05:09.378214 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ef9396f-c773-4917-a320-752d61e9356c None admin] Validating token access rules against request {{(pid=88550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:05:09.417042 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e068dfd-7beb-4196-b63e-460e4fc8441f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '819d41a279e64291acc60de51e1530ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:05:09.418599 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e068dfd-7beb-4196-b63e-460e4fc8441f None admin] REQUEST_METHOD: `POST` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:05:09.419946 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e068dfd-7beb-4196-b63e-460e4fc8441f None admin] SCRIPT_NAME: `/identity` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:05:09.420421 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e068dfd-7beb-4196-b63e-460e4fc8441f None admin] PATH_INFO: `/v3/roles` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:05:09.421279 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e068dfd-7beb-4196-b63e-460e4fc8441f None admin] RBAC: Authorizing `identity:create_role()` {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:05:09.422935 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e068dfd-7beb-4196-b63e-460e4fc8441f None admin] RBAC: Authorization granted {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:05:09.449182 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40f0dde3-7461-4ba8-a234-5d220922d4c8 None admin] Validating token access rules against request {{(pid=88551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:05:09.483791 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7521be41-e4e4-4b4c-829f-c252c2e9adf0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '819d41a279e64291acc60de51e1530ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:05:09.484436 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7521be41-e4e4-4b4c-829f-c252c2e9adf0 None admin] REQUEST_METHOD: `POST` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:05:09.484714 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7521be41-e4e4-4b4c-829f-c252c2e9adf0 None admin] SCRIPT_NAME: `/identity` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:05:09.484988 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7521be41-e4e4-4b4c-829f-c252c2e9adf0 None admin] PATH_INFO: `/v3/projects` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:05:09.485644 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7521be41-e4e4-4b4c-829f-c252c2e9adf0 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=88551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:05:09.487132 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7521be41-e4e4-4b4c-829f-c252c2e9adf0 None admin] RBAC: Authorization granted {{(pid=88551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:05:09.499792 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: [pid: 88550|app: 0|req: 23/45] 10.222.0.26 () {60 vars in 1131 bytes} [Wed Aug 17 19:05:09 2022] POST /identity/v3/roles => generated 223 bytes in 257 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 17 19:05:09.574046 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: [pid: 88551|app: 0|req: 23/46] 10.222.0.26 () {60 vars in 1141 bytes} [Wed Aug 17 19:05:09 2022] POST /identity/v3/projects => generated 312 bytes in 233 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 19:05:11.218260 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ba3df6-db47-4af4-a4c4-bb448a53a85d None None] REQUEST_METHOD: `GET` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:05:11.219249 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ba3df6-db47-4af4-a4c4-bb448a53a85d None None] SCRIPT_NAME: `/identity` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:05:11.219330 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ba3df6-db47-4af4-a4c4-bb448a53a85d None None] PATH_INFO: `/` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:05:11.220632 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: [pid: 88550|app: 0|req: 24/47] 10.222.0.26 () {54 vars in 927 bytes} [Wed Aug 17 19:05:11 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 19:05:11.225908 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab67687-65ab-4a7d-b19b-c80979bbe3e0 None None] REQUEST_METHOD: `POST` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:05:11.226296 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab67687-65ab-4a7d-b19b-c80979bbe3e0 None None] SCRIPT_NAME: `/identity` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:05:11.226499 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab67687-65ab-4a7d-b19b-c80979bbe3e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:05:11.246283 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.auth.core [None req-bab67687-65ab-4a7d-b19b-c80979bbe3e0 None None] MFA Rules not processed for user `819d41a279e64291acc60de51e1530ae`. Rule list: `[]` (Enabled: `True`). {{(pid=88551) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 19:05:11.247878 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.common.fernet_utils [None req-bab67687-65ab-4a7d-b19b-c80979bbe3e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:05:11.307966 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG dbcounter [-] [88551] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:05:11.316015 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: [pid: 88551|app: 0|req: 24/48] 10.222.0.26 () {58 vars in 1024 bytes} [Wed Aug 17 19:05:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 17 19:05:11.641261 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63ba3df6-db47-4af4-a4c4-bb448a53a85d None None] Authenticating user token {{(pid=88550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:05:11.746315 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63ba3df6-db47-4af4-a4c4-bb448a53a85d None None] Validating token access rules against request {{(pid=88550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:05:11.779798 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73516f9e-8e9e-44a6-b5b2-59545953d9e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '819d41a279e64291acc60de51e1530ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:05:11.780425 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73516f9e-8e9e-44a6-b5b2-59545953d9e3 None admin] REQUEST_METHOD: `GET` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:05:11.780705 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73516f9e-8e9e-44a6-b5b2-59545953d9e3 None admin] SCRIPT_NAME: `/identity` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:05:11.781053 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73516f9e-8e9e-44a6-b5b2-59545953d9e3 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:05:11.791640 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73516f9e-8e9e-44a6-b5b2-59545953d9e3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 17 19:05:11.796866 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application [None req-73516f9e-8e9e-44a6-b5b2-59545953d9e3 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 17 19:05:11.796866 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 19:05:11.796866 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 19:05:11.796866 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 19:05:11.796866 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 19:05:11.796866 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 19:05:11.796866 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 19:05:11.796866 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 19:05:11.796866 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 19:05:11.796866 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 19:05:11.796866 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 19:05:11.796866 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 19:05:11.796866 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 17 19:05:11.796866 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 17 19:05:11.796866 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 17 19:05:11.796866 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 17 19:05:11.797789 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 17 19:05:11.797789 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 17 19:05:11.797789 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 17 19:05:11.797789 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 17 19:05:11.797789 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 19:05:11.797789 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 19:05:11.797789 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 19:05:11.797789 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 19:05:11.797789 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 19:05:11.797789 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 19:05:11.797789 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 19:05:11.797789 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application with Lock( Aug 17 19:05:11.797789 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 19:05:11.797789 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return self._enter() Aug 17 19:05:11.797789 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 19:05:11.797789 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 19:05:11.798600 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 19:05:11.798600 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return self.creator() Aug 17 19:05:11.798600 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 19:05:11.798600 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application created_value = creator( Aug 17 19:05:11.798600 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 17 19:05:11.798600 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 17 19:05:11.798600 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 17 19:05:11.798600 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 17 19:05:11.798600 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 17 19:05:11.798600 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 17 19:05:11.798600 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 17 19:05:11.798600 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application Aug 17 19:05:11.798600 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: [pid: 88550|app: 0|req: 25/49] 10.222.0.26 () {56 vars in 1096 bytes} [Wed Aug 17 19:05:11 2022] GET /identity/v3/roles/admin => generated 83 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 19:05:11.800343 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c82d0914-b973-4416-9c36-8b68a811df39 None None] REQUEST_METHOD: `GET` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:05:11.800640 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c82d0914-b973-4416-9c36-8b68a811df39 None None] SCRIPT_NAME: `/identity` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:05:11.800923 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c82d0914-b973-4416-9c36-8b68a811df39 None None] PATH_INFO: `/` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:05:11.802254 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: [pid: 88551|app: 0|req: 25/50] 10.222.0.26 () {54 vars in 927 bytes} [Wed Aug 17 19:05:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 19:05:11.803630 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73516f9e-8e9e-44a6-b5b2-59545953d9e3 None admin] Authenticating user token {{(pid=88550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:05:11.807370 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf352902-5f1c-4c22-aaaa-2f49239374f6 None None] REQUEST_METHOD: `POST` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:05:11.807656 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf352902-5f1c-4c22-aaaa-2f49239374f6 None None] SCRIPT_NAME: `/identity` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:05:11.807934 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf352902-5f1c-4c22-aaaa-2f49239374f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:05:11.823361 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG dbcounter [-] [88550] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:05:11.825980 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.auth.core [None req-bf352902-5f1c-4c22-aaaa-2f49239374f6 None None] MFA Rules not processed for user `819d41a279e64291acc60de51e1530ae`. Rule list: `[]` (Enabled: `True`). {{(pid=88551) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 19:05:11.827197 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.common.fernet_utils [None req-bf352902-5f1c-4c22-aaaa-2f49239374f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:05:11.897743 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: [pid: 88551|app: 0|req: 26/51] 10.222.0.26 () {58 vars in 1024 bytes} [Wed Aug 17 19:05:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 17 19:05:11.906583 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73516f9e-8e9e-44a6-b5b2-59545953d9e3 None admin] Validating token access rules against request {{(pid=88550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:05:11.943415 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caa86c85-6ea5-4857-8026-53aa65e0d520 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '819d41a279e64291acc60de51e1530ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:05:11.944327 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa86c85-6ea5-4857-8026-53aa65e0d520 None admin] REQUEST_METHOD: `GET` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:05:11.944831 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa86c85-6ea5-4857-8026-53aa65e0d520 None admin] SCRIPT_NAME: `/identity` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:05:11.945117 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa86c85-6ea5-4857-8026-53aa65e0d520 None admin] PATH_INFO: `/v3/roles` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:05:11.945786 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caa86c85-6ea5-4857-8026-53aa65e0d520 None admin] RBAC: Adding query filter params (name=admin) {{(pid=88550) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 19:05:11.946095 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caa86c85-6ea5-4857-8026-53aa65e0d520 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:05:11.947556 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caa86c85-6ea5-4857-8026-53aa65e0d520 None admin] RBAC: Authorization granted {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:05:11.956288 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: [pid: 88550|app: 0|req: 26/52] 10.222.0.26 () {56 vars in 1099 bytes} [Wed Aug 17 19:05:11 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 19:05:11.961905 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf352902-5f1c-4c22-aaaa-2f49239374f6 None None] Authenticating user token {{(pid=88551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:05:12.060662 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf352902-5f1c-4c22-aaaa-2f49239374f6 None None] Validating token access rules against request {{(pid=88551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:05:12.083906 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG dbcounter [-] [88551] Writing DB stats keystone:SELECT=100 {{(pid=88551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:05:12.094782 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b86c7aa0-d0e5-4519-a2d8-ec1a50b3e62f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '819d41a279e64291acc60de51e1530ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:05:12.095403 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b86c7aa0-d0e5-4519-a2d8-ec1a50b3e62f None admin] REQUEST_METHOD: `GET` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:05:12.095681 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b86c7aa0-d0e5-4519-a2d8-ec1a50b3e62f None admin] SCRIPT_NAME: `/identity` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:05:12.097339 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b86c7aa0-d0e5-4519-a2d8-ec1a50b3e62f None admin] PATH_INFO: `/v3/users/819d41a279e64291acc60de51e1530ae` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:05:12.097339 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b86c7aa0-d0e5-4519-a2d8-ec1a50b3e62f None admin] RBAC: Authorizing `identity:get_user(user_id=819d41a279e64291acc60de51e1530ae)` {{(pid=88551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:05:12.098530 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b86c7aa0-d0e5-4519-a2d8-ec1a50b3e62f None admin] RBAC: Authorization granted {{(pid=88551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:05:12.100122 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: [pid: 88551|app: 0|req: 27/53] 10.222.0.26 () {56 vars in 1177 bytes} [Wed Aug 17 19:05:11 2022] GET /identity/v3/users/819d41a279e64291acc60de51e1530ae => generated 247 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 17 19:05:12.105618 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caa86c85-6ea5-4857-8026-53aa65e0d520 None admin] Authenticating user token {{(pid=88550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:05:12.187924 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG dbcounter [-] [88550] Writing DB stats keystone:SELECT=100 {{(pid=88550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:05:12.206730 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caa86c85-6ea5-4857-8026-53aa65e0d520 None admin] Validating token access rules against request {{(pid=88550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:05:12.221189 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b86c7aa0-d0e5-4519-a2d8-ec1a50b3e62f None admin] Authenticating user token {{(pid=88551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:05:12.242096 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d5bf275-495c-4cf3-8d31-621f70b98be3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '819d41a279e64291acc60de51e1530ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:05:12.242782 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d5bf275-495c-4cf3-8d31-621f70b98be3 None admin] REQUEST_METHOD: `GET` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:05:12.243069 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d5bf275-495c-4cf3-8d31-621f70b98be3 None admin] SCRIPT_NAME: `/identity` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:05:12.243735 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d5bf275-495c-4cf3-8d31-621f70b98be3 None admin] PATH_INFO: `/v3/domains/default` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:05:12.244508 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d5bf275-495c-4cf3-8d31-621f70b98be3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:05:12.245960 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d5bf275-495c-4cf3-8d31-621f70b98be3 None admin] RBAC: Authorization granted {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:05:12.247575 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: [pid: 88550|app: 0|req: 27/54] 10.222.0.26 () {56 vars in 1108 bytes} [Wed Aug 17 19:05:12 2022] GET /identity/v3/domains/default => generated 199 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 19:05:12.253229 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d5bf275-495c-4cf3-8d31-621f70b98be3 None admin] Authenticating user token {{(pid=88550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:05:12.325702 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b86c7aa0-d0e5-4519-a2d8-ec1a50b3e62f None admin] Validating token access rules against request {{(pid=88551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:05:12.353105 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d5bf275-495c-4cf3-8d31-621f70b98be3 None admin] Validating token access rules against request {{(pid=88550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:05:12.359849 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c77351da-ac2f-4aa7-adf1-4dea3b76a60d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '819d41a279e64291acc60de51e1530ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:05:12.360580 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c77351da-ac2f-4aa7-adf1-4dea3b76a60d None admin] REQUEST_METHOD: `GET` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:05:12.360861 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c77351da-ac2f-4aa7-adf1-4dea3b76a60d None admin] SCRIPT_NAME: `/identity` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:05:12.361131 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c77351da-ac2f-4aa7-adf1-4dea3b76a60d None admin] PATH_INFO: `/v3/domains/default` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:05:12.362233 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c77351da-ac2f-4aa7-adf1-4dea3b76a60d None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=88551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:05:12.363725 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c77351da-ac2f-4aa7-adf1-4dea3b76a60d None admin] RBAC: Authorization granted {{(pid=88551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:05:12.365292 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: [pid: 88551|app: 0|req: 28/55] 10.222.0.26 () {56 vars in 1108 bytes} [Wed Aug 17 19:05:12 2022] GET /identity/v3/domains/default => generated 199 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 17 19:05:12.370765 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c77351da-ac2f-4aa7-adf1-4dea3b76a60d None admin] Authenticating user token {{(pid=88551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:05:12.387301 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b778bf2e-57ea-4965-b2a2-c163c9766887 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '819d41a279e64291acc60de51e1530ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:05:12.387908 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b778bf2e-57ea-4965-b2a2-c163c9766887 None admin] REQUEST_METHOD: `GET` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:05:12.388190 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b778bf2e-57ea-4965-b2a2-c163c9766887 None admin] SCRIPT_NAME: `/identity` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:05:12.388464 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b778bf2e-57ea-4965-b2a2-c163c9766887 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:05:12.389187 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b778bf2e-57ea-4965-b2a2-c163c9766887 None admin] RBAC: Adding query filter params (role.id=204f62ae18174b60a2e3f5d4f28ea326, scope.domain.id=default, user.id=819d41a279e64291acc60de51e1530ae) {{(pid=88550) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 19:05:12.389491 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b778bf2e-57ea-4965-b2a2-c163c9766887 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:05:12.391460 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b778bf2e-57ea-4965-b2a2-c163c9766887 None admin] RBAC: Authorization granted {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:05:12.397172 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: [pid: 88550|app: 0|req: 28/56] 10.222.0.26 () {56 vars in 1322 bytes} [Wed Aug 17 19:05:12 2022] GET /identity/v3/role_assignments?user.id=819d41a279e64291acc60de51e1530ae&scope.domain.id=default&role.id=204f62ae18174b60a2e3f5d4f28ea326 => generated 530 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 17 19:05:12.431757 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG dbcounter [-] [88551] Writing DB stats keystone:SELECT=100 {{(pid=88551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:05:12.475445 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c77351da-ac2f-4aa7-adf1-4dea3b76a60d None admin] Validating token access rules against request {{(pid=88551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:05:12.512092 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4538957d-40ae-4767-bd15-61220b517c19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '819d41a279e64291acc60de51e1530ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:05:12.512763 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4538957d-40ae-4767-bd15-61220b517c19 None admin] REQUEST_METHOD: `POST` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:05:12.513043 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4538957d-40ae-4767-bd15-61220b517c19 None admin] SCRIPT_NAME: `/identity` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:05:12.513314 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4538957d-40ae-4767-bd15-61220b517c19 None admin] PATH_INFO: `/v3/projects` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:05:12.513967 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4538957d-40ae-4767-bd15-61220b517c19 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=88551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:05:12.516005 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4538957d-40ae-4767-bd15-61220b517c19 None admin] RBAC: Authorization granted {{(pid=88551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:05:12.601971 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: [pid: 88551|app: 0|req: 29/57] 10.222.0.26 () {60 vars in 1140 bytes} [Wed Aug 17 19:05:12 2022] POST /identity/v3/projects => generated 298 bytes in 231 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 17 19:05:14.778884 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d561f5-6bf2-4753-be2b-3b27c38d2f01 None None] REQUEST_METHOD: `GET` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:05:14.779403 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d561f5-6bf2-4753-be2b-3b27c38d2f01 None None] SCRIPT_NAME: `/identity` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:05:14.779486 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d561f5-6bf2-4753-be2b-3b27c38d2f01 None None] PATH_INFO: `/` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:05:14.781325 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: [pid: 88550|app: 0|req: 29/58] 10.222.0.26 () {54 vars in 927 bytes} [Wed Aug 17 19:05:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 19:05:14.786647 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ce3f9f-e8b7-4d27-99c9-20bcf8d85efc None None] REQUEST_METHOD: `POST` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:05:14.787072 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ce3f9f-e8b7-4d27-99c9-20bcf8d85efc None None] SCRIPT_NAME: `/identity` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:05:14.787199 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ce3f9f-e8b7-4d27-99c9-20bcf8d85efc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:05:14.804987 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.auth.core [None req-43ce3f9f-e8b7-4d27-99c9-20bcf8d85efc None None] MFA Rules not processed for user `819d41a279e64291acc60de51e1530ae`. Rule list: `[]` (Enabled: `True`). {{(pid=88551) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 19:05:14.806174 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.common.fernet_utils [None req-43ce3f9f-e8b7-4d27-99c9-20bcf8d85efc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:05:14.872349 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: [pid: 88551|app: 0|req: 30/59] 10.222.0.26 () {58 vars in 1024 bytes} [Wed Aug 17 19:05:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 17 19:05:15.197480 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97d561f5-6bf2-4753-be2b-3b27c38d2f01 None None] Authenticating user token {{(pid=88550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:05:15.212316 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG dbcounter [-] [88550] Writing DB stats keystone:SELECT=100 {{(pid=88550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:05:15.298324 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97d561f5-6bf2-4753-be2b-3b27c38d2f01 None None] Validating token access rules against request {{(pid=88550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:05:15.331827 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6daf9e9e-b221-4e53-9987-4e4918345707 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '819d41a279e64291acc60de51e1530ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:05:15.332442 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6daf9e9e-b221-4e53-9987-4e4918345707 None admin] REQUEST_METHOD: `GET` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:05:15.332723 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6daf9e9e-b221-4e53-9987-4e4918345707 None admin] SCRIPT_NAME: `/identity` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:05:15.332997 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6daf9e9e-b221-4e53-9987-4e4918345707 None admin] PATH_INFO: `/v3/domains/default` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:05:15.334099 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6daf9e9e-b221-4e53-9987-4e4918345707 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:05:15.335569 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6daf9e9e-b221-4e53-9987-4e4918345707 None admin] RBAC: Authorization granted {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:05:15.337144 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: [pid: 88550|app: 0|req: 30/60] 10.222.0.26 () {56 vars in 1108 bytes} [Wed Aug 17 19:05:15 2022] GET /identity/v3/domains/default => generated 199 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 19:05:15.343057 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43ce3f9f-e8b7-4d27-99c9-20bcf8d85efc None None] Authenticating user token {{(pid=88551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:05:15.387322 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG dbcounter [-] [88551] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:05:15.443146 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43ce3f9f-e8b7-4d27-99c9-20bcf8d85efc None None] Validating token access rules against request {{(pid=88551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:05:15.476932 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5ffd26b-3951-444e-9c17-35a8dc189681 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '819d41a279e64291acc60de51e1530ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:05:15.477467 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ffd26b-3951-444e-9c17-35a8dc189681 None admin] REQUEST_METHOD: `POST` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:05:15.477743 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ffd26b-3951-444e-9c17-35a8dc189681 None admin] SCRIPT_NAME: `/identity` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:05:15.478012 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ffd26b-3951-444e-9c17-35a8dc189681 None admin] PATH_INFO: `/v3/users` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:05:15.478695 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5ffd26b-3951-444e-9c17-35a8dc189681 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=88551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:05:15.480130 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5ffd26b-3951-444e-9c17-35a8dc189681 None admin] RBAC: Authorization granted {{(pid=88551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:05:15.606228 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: [pid: 88551|app: 0|req: 31/61] 10.222.0.26 () {60 vars in 1132 bytes} [Wed Aug 17 19:05:15 2022] POST /identity/v3/users => generated 275 bytes in 264 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 19:05:18.979548 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d383819f-df5c-451c-877c-d192456d1521 None None] REQUEST_METHOD: `GET` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:05:18.980495 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d383819f-df5c-451c-877c-d192456d1521 None None] SCRIPT_NAME: `/identity` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:05:18.980965 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d383819f-df5c-451c-877c-d192456d1521 None None] PATH_INFO: `/` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:05:18.982500 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: [pid: 88550|app: 0|req: 31/62] 10.222.0.26 () {54 vars in 927 bytes} [Wed Aug 17 19:05:18 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 19:05:18.988842 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a83ae78-5553-4197-b754-f58f4c1d76b1 None None] REQUEST_METHOD: `POST` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:05:18.989730 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a83ae78-5553-4197-b754-f58f4c1d76b1 None None] SCRIPT_NAME: `/identity` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:05:18.990202 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a83ae78-5553-4197-b754-f58f4c1d76b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:05:19.009754 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd456d62-357c-4a5e-8060-264d3b7d1fb2 None None] REQUEST_METHOD: `GET` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:05:19.010382 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd456d62-357c-4a5e-8060-264d3b7d1fb2 None None] SCRIPT_NAME: `/identity` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:05:19.010873 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd456d62-357c-4a5e-8060-264d3b7d1fb2 None None] PATH_INFO: `/` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:05:19.012521 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: [pid: 88550|app: 0|req: 32/63] 10.222.0.26 () {54 vars in 927 bytes} [Wed Aug 17 19:05:19 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 19:05:19.019883 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b5a56c7-0cf5-42a8-8564-7f37af51daa3 None None] REQUEST_METHOD: `POST` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:05:19.020440 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b5a56c7-0cf5-42a8-8564-7f37af51daa3 None None] SCRIPT_NAME: `/identity` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:05:19.020910 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b5a56c7-0cf5-42a8-8564-7f37af51daa3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:05:19.021307 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.auth.core [None req-7a83ae78-5553-4197-b754-f58f4c1d76b1 None None] MFA Rules not processed for user `819d41a279e64291acc60de51e1530ae`. Rule list: `[]` (Enabled: `True`). {{(pid=88551) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 19:05:19.022505 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.common.fernet_utils [None req-7a83ae78-5553-4197-b754-f58f4c1d76b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:05:19.050731 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.auth.core [None req-4b5a56c7-0cf5-42a8-8564-7f37af51daa3 None None] MFA Rules not processed for user `819d41a279e64291acc60de51e1530ae`. Rule list: `[]` (Enabled: `True`). {{(pid=88550) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 19:05:19.051936 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.common.fernet_utils [None req-4b5a56c7-0cf5-42a8-8564-7f37af51daa3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:05:19.158085 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: [pid: 88551|app: 0|req: 32/64] 10.222.0.26 () {58 vars in 1024 bytes} [Wed Aug 17 19:05:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 17 19:05:19.175003 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: [pid: 88550|app: 0|req: 33/65] 10.222.0.26 () {58 vars in 1024 bytes} [Wed Aug 17 19:05:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 17 19:05:19.272321 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1166ba84-cdb1-4514-af9c-d033a52912df None None] REQUEST_METHOD: `GET` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:05:19.272667 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1166ba84-cdb1-4514-af9c-d033a52912df None None] SCRIPT_NAME: `/identity` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:05:19.272884 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1166ba84-cdb1-4514-af9c-d033a52912df None None] PATH_INFO: `/` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:05:19.274371 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: [pid: 88551|app: 0|req: 33/66] 10.222.0.26 () {54 vars in 927 bytes} [Wed Aug 17 19:05:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 19:05:19.279530 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c5cb898-6378-442f-b759-4f75fadcd05a None None] REQUEST_METHOD: `POST` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:05:19.279827 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c5cb898-6378-442f-b759-4f75fadcd05a None None] SCRIPT_NAME: `/identity` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:05:19.280106 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c5cb898-6378-442f-b759-4f75fadcd05a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:05:19.301168 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.auth.core [None req-8c5cb898-6378-442f-b759-4f75fadcd05a None None] MFA Rules not processed for user `819d41a279e64291acc60de51e1530ae`. Rule list: `[]` (Enabled: `True`). {{(pid=88550) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 19:05:19.302461 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.common.fernet_utils [None req-8c5cb898-6378-442f-b759-4f75fadcd05a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:05:19.305430 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG dbcounter [-] [88550] Writing DB stats keystone:SELECT=100 {{(pid=88550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:05:19.387814 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: [pid: 88550|app: 0|req: 34/67] 10.222.0.26 () {58 vars in 1024 bytes} [Wed Aug 17 19:05:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 17 19:05:19.627514 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7afc26cc-fb82-4c79-8532-1036256f4cc7 None None] REQUEST_METHOD: `GET` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:05:19.628180 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7afc26cc-fb82-4c79-8532-1036256f4cc7 None None] SCRIPT_NAME: `/identity` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:05:19.628659 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7afc26cc-fb82-4c79-8532-1036256f4cc7 None None] PATH_INFO: `/` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:05:19.630444 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: [pid: 88551|app: 0|req: 34/68] 10.222.0.26 () {54 vars in 927 bytes} [Wed Aug 17 19:05:19 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 19:05:19.635470 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-783ca949-6c45-4ffc-b022-08db74d95880 None None] REQUEST_METHOD: `POST` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:05:19.636029 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-783ca949-6c45-4ffc-b022-08db74d95880 None None] SCRIPT_NAME: `/identity` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:05:19.636516 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-783ca949-6c45-4ffc-b022-08db74d95880 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:05:19.654848 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7afc26cc-fb82-4c79-8532-1036256f4cc7 None None] Authenticating user token {{(pid=88551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:05:19.660903 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.auth.core [None req-783ca949-6c45-4ffc-b022-08db74d95880 None None] MFA Rules not processed for user `819d41a279e64291acc60de51e1530ae`. Rule list: `[]` (Enabled: `True`). {{(pid=88550) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 19:05:19.662107 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.common.fernet_utils [None req-783ca949-6c45-4ffc-b022-08db74d95880 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:05:19.694974 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG dbcounter [-] [88551] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:05:19.767528 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: [pid: 88550|app: 0|req: 35/69] 10.222.0.26 () {58 vars in 1024 bytes} [Wed Aug 17 19:05:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 17 19:05:19.769000 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f27d7f8-7ca4-4e5c-84a3-2416bf1794ec None None] REQUEST_METHOD: `GET` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:05:19.769432 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f27d7f8-7ca4-4e5c-84a3-2416bf1794ec None None] SCRIPT_NAME: `/identity` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:05:19.769842 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f27d7f8-7ca4-4e5c-84a3-2416bf1794ec None None] PATH_INFO: `/` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:05:19.771374 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: [pid: 88550|app: 0|req: 36/70] 10.222.0.26 () {54 vars in 927 bytes} [Wed Aug 17 19:05:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 19:05:19.775909 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f27d7f8-7ca4-4e5c-84a3-2416bf1794ec None None] Authenticating user token {{(pid=88550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:05:19.804881 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7afc26cc-fb82-4c79-8532-1036256f4cc7 None None] Validating token access rules against request {{(pid=88551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:05:19.840856 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01a228e6-7f6c-4977-aa3a-95ad1ec9cbd9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '819d41a279e64291acc60de51e1530ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:05:19.841483 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a228e6-7f6c-4977-aa3a-95ad1ec9cbd9 None admin] REQUEST_METHOD: `GET` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:05:19.841761 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a228e6-7f6c-4977-aa3a-95ad1ec9cbd9 None admin] SCRIPT_NAME: `/identity` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:05:19.842047 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a228e6-7f6c-4977-aa3a-95ad1ec9cbd9 None admin] PATH_INFO: `/v3/roles/member` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:05:19.853571 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01a228e6-7f6c-4977-aa3a-95ad1ec9cbd9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 17 19:05:19.860285 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application [None req-01a228e6-7f6c-4977-aa3a-95ad1ec9cbd9 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 17 19:05:19.860285 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 19:05:19.860285 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 19:05:19.860285 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 19:05:19.860285 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 19:05:19.860285 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 19:05:19.860285 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 19:05:19.860285 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 19:05:19.860285 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 19:05:19.860285 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 19:05:19.860285 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 19:05:19.860285 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 19:05:19.860285 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 17 19:05:19.860285 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 17 19:05:19.860285 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 17 19:05:19.860285 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 17 19:05:19.861360 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 17 19:05:19.861360 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 17 19:05:19.861360 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 17 19:05:19.861360 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 17 19:05:19.861360 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 19:05:19.861360 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 19:05:19.861360 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 19:05:19.861360 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 19:05:19.861360 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 19:05:19.861360 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 19:05:19.861360 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 19:05:19.861360 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application with Lock( Aug 17 19:05:19.861360 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 19:05:19.861360 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application return self._enter() Aug 17 19:05:19.861360 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 19:05:19.861360 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 19:05:19.862334 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 19:05:19.862334 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application return self.creator() Aug 17 19:05:19.862334 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 19:05:19.862334 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application created_value = creator( Aug 17 19:05:19.862334 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 17 19:05:19.862334 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 17 19:05:19.862334 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 17 19:05:19.862334 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 17 19:05:19.862334 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 17 19:05:19.862334 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 17 19:05:19.862334 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 17 19:05:19.862334 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application Aug 17 19:05:19.862334 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: [pid: 88551|app: 0|req: 35/71] 10.222.0.26 () {56 vars in 1099 bytes} [Wed Aug 17 19:05:19 2022] GET /identity/v3/roles/member => generated 84 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 17 19:05:19.863148 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2cd46c9-3f7d-4810-a2b8-17475d72e27e None None] REQUEST_METHOD: `POST` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:05:19.863148 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2cd46c9-3f7d-4810-a2b8-17475d72e27e None None] SCRIPT_NAME: `/identity` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:05:19.863148 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2cd46c9-3f7d-4810-a2b8-17475d72e27e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:05:19.883431 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.auth.core [None req-d2cd46c9-3f7d-4810-a2b8-17475d72e27e None None] MFA Rules not processed for user `819d41a279e64291acc60de51e1530ae`. Rule list: `[]` (Enabled: `True`). {{(pid=88551) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 19:05:19.884533 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.common.fernet_utils [None req-d2cd46c9-3f7d-4810-a2b8-17475d72e27e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:05:19.889364 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG dbcounter [-] [88550] Writing DB stats keystone:SELECT=100 {{(pid=88550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:05:19.922896 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f27d7f8-7ca4-4e5c-84a3-2416bf1794ec None None] Validating token access rules against request {{(pid=88550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:05:19.961646 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: [pid: 88551|app: 0|req: 36/72] 10.222.0.26 () {58 vars in 1024 bytes} [Wed Aug 17 19:05:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 17 19:05:19.962846 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2cd46c9-3f7d-4810-a2b8-17475d72e27e None None] Authenticating user token {{(pid=88551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:05:19.972399 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0b944b0-7685-4250-a7db-5cb182cf402b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '819d41a279e64291acc60de51e1530ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:05:19.973319 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b944b0-7685-4250-a7db-5cb182cf402b None admin] REQUEST_METHOD: `GET` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:05:19.973870 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b944b0-7685-4250-a7db-5cb182cf402b None admin] SCRIPT_NAME: `/identity` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:05:19.974816 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b944b0-7685-4250-a7db-5cb182cf402b None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:05:19.983346 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG dbcounter [-] [88551] Writing DB stats keystone:SELECT=100 {{(pid=88551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:05:19.990901 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0b944b0-7685-4250-a7db-5cb182cf402b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 17 19:05:19.997980 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application [None req-e0b944b0-7685-4250-a7db-5cb182cf402b None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 17 19:05:19.997980 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 19:05:19.997980 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 19:05:19.997980 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 19:05:19.997980 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 19:05:19.997980 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 19:05:19.997980 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 19:05:19.997980 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 19:05:19.997980 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 19:05:19.997980 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 19:05:19.997980 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 19:05:19.997980 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 19:05:19.997980 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 17 19:05:19.997980 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 17 19:05:19.997980 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 17 19:05:19.997980 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 17 19:05:19.999092 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 17 19:05:19.999092 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 17 19:05:19.999092 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 17 19:05:19.999092 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 17 19:05:19.999092 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 19:05:19.999092 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 19:05:19.999092 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 19:05:19.999092 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 19:05:19.999092 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 19:05:19.999092 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 19:05:19.999092 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 19:05:19.999092 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application with Lock( Aug 17 19:05:19.999092 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 19:05:19.999092 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return self._enter() Aug 17 19:05:19.999092 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 19:05:19.999092 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 19:05:20.000080 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 19:05:20.000080 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return self.creator() Aug 17 19:05:20.000080 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 19:05:20.000080 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application created_value = creator( Aug 17 19:05:20.000080 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 17 19:05:20.000080 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 17 19:05:20.000080 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 17 19:05:20.000080 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 17 19:05:20.000080 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 17 19:05:20.000080 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 17 19:05:20.000080 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 17 19:05:20.000080 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application Aug 17 19:05:20.002493 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: [pid: 88550|app: 0|req: 37/73] 10.222.0.26 () {56 vars in 1096 bytes} [Wed Aug 17 19:05:19 2022] GET /identity/v3/roles/admin => generated 83 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 19:05:20.004338 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0b944b0-7685-4250-a7db-5cb182cf402b None admin] Authenticating user token {{(pid=88550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:05:20.077016 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2cd46c9-3f7d-4810-a2b8-17475d72e27e None None] Validating token access rules against request {{(pid=88551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:05:20.123261 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12309136-51b5-440a-b4f4-db24e109d176 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '819d41a279e64291acc60de51e1530ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:05:20.123990 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12309136-51b5-440a-b4f4-db24e109d176 None admin] REQUEST_METHOD: `GET` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:05:20.124867 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12309136-51b5-440a-b4f4-db24e109d176 None admin] SCRIPT_NAME: `/identity` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:05:20.125229 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12309136-51b5-440a-b4f4-db24e109d176 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:05:20.127999 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0b944b0-7685-4250-a7db-5cb182cf402b None admin] Validating token access rules against request {{(pid=88550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:05:20.138716 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12309136-51b5-440a-b4f4-db24e109d176 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 17 19:05:20.144628 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application [None req-12309136-51b5-440a-b4f4-db24e109d176 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 17 19:05:20.144628 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 19:05:20.144628 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 19:05:20.144628 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 19:05:20.144628 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 19:05:20.144628 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 19:05:20.144628 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 19:05:20.144628 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 19:05:20.144628 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 19:05:20.144628 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 19:05:20.144628 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 19:05:20.144628 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 19:05:20.144628 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 17 19:05:20.144628 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 17 19:05:20.144628 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 17 19:05:20.144628 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 17 19:05:20.145512 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 17 19:05:20.145512 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 17 19:05:20.145512 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 17 19:05:20.145512 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 17 19:05:20.145512 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 19:05:20.145512 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 19:05:20.145512 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 19:05:20.145512 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 19:05:20.145512 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 19:05:20.145512 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 19:05:20.145512 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 19:05:20.145512 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application with Lock( Aug 17 19:05:20.145512 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 19:05:20.145512 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application return self._enter() Aug 17 19:05:20.145512 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 19:05:20.145512 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 19:05:20.146272 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 19:05:20.146272 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application return self.creator() Aug 17 19:05:20.146272 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 19:05:20.146272 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application created_value = creator( Aug 17 19:05:20.146272 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 17 19:05:20.146272 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 17 19:05:20.146272 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 17 19:05:20.146272 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 17 19:05:20.146272 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 17 19:05:20.146272 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 17 19:05:20.146272 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 17 19:05:20.146272 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application Aug 17 19:05:20.146272 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: [pid: 88551|app: 0|req: 37/74] 10.222.0.26 () {56 vars in 1114 bytes} [Wed Aug 17 19:05:19 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 19:05:20.146932 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12309136-51b5-440a-b4f4-db24e109d176 None admin] Authenticating user token {{(pid=88551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:05:20.166415 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG dbcounter [-] [88550] Writing DB stats keystone:SELECT=100 {{(pid=88550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:05:20.172109 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab8d04d1-0139-47ff-9ebf-e6b50119bd3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '819d41a279e64291acc60de51e1530ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:05:20.173242 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab8d04d1-0139-47ff-9ebf-e6b50119bd3e None admin] REQUEST_METHOD: `GET` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:05:20.173242 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab8d04d1-0139-47ff-9ebf-e6b50119bd3e None admin] SCRIPT_NAME: `/identity` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:05:20.173242 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab8d04d1-0139-47ff-9ebf-e6b50119bd3e None admin] PATH_INFO: `/v3/roles` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:05:20.173933 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab8d04d1-0139-47ff-9ebf-e6b50119bd3e None admin] RBAC: Adding query filter params (name=member) {{(pid=88550) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 19:05:20.174234 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab8d04d1-0139-47ff-9ebf-e6b50119bd3e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:05:20.175874 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab8d04d1-0139-47ff-9ebf-e6b50119bd3e None admin] RBAC: Authorization granted {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:05:20.184627 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: [pid: 88550|app: 0|req: 38/75] 10.222.0.26 () {56 vars in 1101 bytes} [Wed Aug 17 19:05:20 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 19:05:20.188216 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab8d04d1-0139-47ff-9ebf-e6b50119bd3e None admin] Authenticating user token {{(pid=88550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:05:20.233853 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG dbcounter [-] [88551] Writing DB stats keystone:SELECT=100 {{(pid=88551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:05:20.256314 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12309136-51b5-440a-b4f4-db24e109d176 None admin] Validating token access rules against request {{(pid=88551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:05:20.295812 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fa1a115-218c-47af-be98-6df36fa8accb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '819d41a279e64291acc60de51e1530ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:05:20.297216 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa1a115-218c-47af-be98-6df36fa8accb None admin] REQUEST_METHOD: `GET` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:05:20.297496 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa1a115-218c-47af-be98-6df36fa8accb None admin] SCRIPT_NAME: `/identity` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:05:20.297767 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa1a115-218c-47af-be98-6df36fa8accb None admin] PATH_INFO: `/v3/roles` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:05:20.298433 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fa1a115-218c-47af-be98-6df36fa8accb None admin] RBAC: Adding query filter params (name=admin) {{(pid=88551) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 19:05:20.298772 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fa1a115-218c-47af-be98-6df36fa8accb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:05:20.300171 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fa1a115-218c-47af-be98-6df36fa8accb None admin] RBAC: Authorization granted {{(pid=88551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:05:20.304843 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab8d04d1-0139-47ff-9ebf-e6b50119bd3e None admin] Validating token access rules against request {{(pid=88550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:05:20.312182 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: [pid: 88551|app: 0|req: 38/76] 10.222.0.26 () {56 vars in 1099 bytes} [Wed Aug 17 19:05:20 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 19:05:20.313070 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fa1a115-218c-47af-be98-6df36fa8accb None admin] Authenticating user token {{(pid=88551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:05:20.339382 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28e9dd93-0884-45b9-8216-8457229dddb0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '819d41a279e64291acc60de51e1530ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:05:20.340020 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e9dd93-0884-45b9-8216-8457229dddb0 None admin] REQUEST_METHOD: `GET` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:05:20.340308 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e9dd93-0884-45b9-8216-8457229dddb0 None admin] SCRIPT_NAME: `/identity` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:05:20.340591 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e9dd93-0884-45b9-8216-8457229dddb0 None admin] PATH_INFO: `/v3/roles/member` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:05:20.351563 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28e9dd93-0884-45b9-8216-8457229dddb0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 17 19:05:20.356782 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application [None req-28e9dd93-0884-45b9-8216-8457229dddb0 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 17 19:05:20.356782 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 19:05:20.356782 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 19:05:20.356782 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 19:05:20.356782 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 19:05:20.356782 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 19:05:20.356782 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 19:05:20.356782 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 19:05:20.356782 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 19:05:20.356782 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 19:05:20.356782 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 19:05:20.356782 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 19:05:20.356782 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 17 19:05:20.356782 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 17 19:05:20.356782 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 17 19:05:20.356782 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 17 19:05:20.357816 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 17 19:05:20.357816 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 17 19:05:20.357816 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 17 19:05:20.357816 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 17 19:05:20.357816 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 19:05:20.357816 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 19:05:20.357816 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 19:05:20.357816 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 19:05:20.357816 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 19:05:20.357816 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 19:05:20.357816 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 19:05:20.357816 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application with Lock( Aug 17 19:05:20.357816 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 19:05:20.357816 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return self._enter() Aug 17 19:05:20.357816 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 19:05:20.357816 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 19:05:20.358694 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 19:05:20.358694 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return self.creator() Aug 17 19:05:20.358694 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 19:05:20.358694 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application created_value = creator( Aug 17 19:05:20.358694 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 17 19:05:20.358694 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 17 19:05:20.358694 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 17 19:05:20.358694 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 17 19:05:20.358694 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 17 19:05:20.358694 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 17 19:05:20.358694 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 17 19:05:20.358694 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application Aug 17 19:05:20.358694 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: [pid: 88550|app: 0|req: 39/77] 10.222.0.26 () {56 vars in 1099 bytes} [Wed Aug 17 19:05:20 2022] GET /identity/v3/roles/member => generated 84 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 19:05:20.358694 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28e9dd93-0884-45b9-8216-8457229dddb0 None admin] Authenticating user token {{(pid=88550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:05:20.411445 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG dbcounter [-] [88550] Writing DB stats keystone:SELECT=100 {{(pid=88550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:05:20.415220 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fa1a115-218c-47af-be98-6df36fa8accb None admin] Validating token access rules against request {{(pid=88551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:05:20.450401 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-416a0b83-bb8e-4d28-9e4d-db3407ca93a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '819d41a279e64291acc60de51e1530ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:05:20.451073 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-416a0b83-bb8e-4d28-9e4d-db3407ca93a4 None admin] REQUEST_METHOD: `GET` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:05:20.451363 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-416a0b83-bb8e-4d28-9e4d-db3407ca93a4 None admin] SCRIPT_NAME: `/identity` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:05:20.451634 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-416a0b83-bb8e-4d28-9e4d-db3407ca93a4 None admin] PATH_INFO: `/v3/roles` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:05:20.452292 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-416a0b83-bb8e-4d28-9e4d-db3407ca93a4 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=88551) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 19:05:20.452619 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-416a0b83-bb8e-4d28-9e4d-db3407ca93a4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:05:20.453986 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-416a0b83-bb8e-4d28-9e4d-db3407ca93a4 None admin] RBAC: Authorization granted {{(pid=88551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:05:20.458253 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28e9dd93-0884-45b9-8216-8457229dddb0 None admin] Validating token access rules against request {{(pid=88550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:05:20.462048 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: [pid: 88551|app: 0|req: 39/78] 10.222.0.26 () {56 vars in 1111 bytes} [Wed Aug 17 19:05:20 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 19:05:20.462873 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-416a0b83-bb8e-4d28-9e4d-db3407ca93a4 None admin] Authenticating user token {{(pid=88551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:05:20.465514 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG dbcounter [-] [88551] Writing DB stats keystone:SELECT=100 {{(pid=88551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:05:20.495160 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-116be807-76af-4055-abd0-79892efcf101 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '819d41a279e64291acc60de51e1530ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:05:20.495895 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-116be807-76af-4055-abd0-79892efcf101 None admin] REQUEST_METHOD: `GET` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:05:20.496250 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-116be807-76af-4055-abd0-79892efcf101 None admin] SCRIPT_NAME: `/identity` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:05:20.496605 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-116be807-76af-4055-abd0-79892efcf101 None admin] PATH_INFO: `/v3/users/42ca546140f547848db6ed420a5044f3` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:05:20.512132 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-116be807-76af-4055-abd0-79892efcf101 None admin] RBAC: Authorizing `identity:get_user(user_id=42ca546140f547848db6ed420a5044f3)` {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:05:20.513621 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-116be807-76af-4055-abd0-79892efcf101 None admin] RBAC: Authorization granted {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:05:20.516005 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: [pid: 88550|app: 0|req: 40/79] 10.222.0.26 () {56 vars in 1177 bytes} [Wed Aug 17 19:05:20 2022] GET /identity/v3/users/42ca546140f547848db6ed420a5044f3 => generated 275 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 19:05:20.516665 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-116be807-76af-4055-abd0-79892efcf101 None admin] Authenticating user token {{(pid=88550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:05:20.574279 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-416a0b83-bb8e-4d28-9e4d-db3407ca93a4 None admin] Validating token access rules against request {{(pid=88551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:05:20.610077 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ef97c2c-5c7b-4333-9247-4b2b58c067b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '819d41a279e64291acc60de51e1530ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:05:20.610743 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef97c2c-5c7b-4333-9247-4b2b58c067b1 None admin] REQUEST_METHOD: `GET` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:05:20.611034 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef97c2c-5c7b-4333-9247-4b2b58c067b1 None admin] SCRIPT_NAME: `/identity` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:05:20.611334 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef97c2c-5c7b-4333-9247-4b2b58c067b1 None admin] PATH_INFO: `/v3/domains/default` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:05:20.612465 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ef97c2c-5c7b-4333-9247-4b2b58c067b1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=88551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:05:20.613919 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ef97c2c-5c7b-4333-9247-4b2b58c067b1 None admin] RBAC: Authorization granted {{(pid=88551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:05:20.615538 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: [pid: 88551|app: 0|req: 40/80] 10.222.0.26 () {56 vars in 1108 bytes} [Wed Aug 17 19:05:20 2022] GET /identity/v3/domains/default => generated 199 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 19:05:20.616300 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ef97c2c-5c7b-4333-9247-4b2b58c067b1 None admin] Authenticating user token {{(pid=88551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:05:20.620395 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-116be807-76af-4055-abd0-79892efcf101 None admin] Validating token access rules against request {{(pid=88550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:05:20.633834 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG dbcounter [-] [88550] Writing DB stats keystone:SELECT=100 {{(pid=88550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:05:20.657865 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2962592-a4e5-41c8-8699-0c484c07819d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '819d41a279e64291acc60de51e1530ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:05:20.658498 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2962592-a4e5-41c8-8699-0c484c07819d None admin] REQUEST_METHOD: `GET` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:05:20.658833 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2962592-a4e5-41c8-8699-0c484c07819d None admin] SCRIPT_NAME: `/identity` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:05:20.659110 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2962592-a4e5-41c8-8699-0c484c07819d None admin] PATH_INFO: `/v3/users/819d41a279e64291acc60de51e1530ae` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:05:20.660274 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2962592-a4e5-41c8-8699-0c484c07819d None admin] RBAC: Authorizing `identity:get_user(user_id=819d41a279e64291acc60de51e1530ae)` {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:05:20.661821 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2962592-a4e5-41c8-8699-0c484c07819d None admin] RBAC: Authorization granted {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:05:20.663558 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: [pid: 88550|app: 0|req: 41/81] 10.222.0.26 () {56 vars in 1177 bytes} [Wed Aug 17 19:05:20 2022] GET /identity/v3/users/819d41a279e64291acc60de51e1530ae => generated 247 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 19:05:20.664185 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2962592-a4e5-41c8-8699-0c484c07819d None admin] Authenticating user token {{(pid=88550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:05:20.691320 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG dbcounter [-] [88551] Writing DB stats keystone:SELECT=100 {{(pid=88551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:05:20.723290 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ef97c2c-5c7b-4333-9247-4b2b58c067b1 None admin] Validating token access rules against request {{(pid=88551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:05:20.761159 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-026c1133-1564-4e46-bacc-cb37cb5b47c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '819d41a279e64291acc60de51e1530ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:05:20.761774 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-026c1133-1564-4e46-bacc-cb37cb5b47c3 None admin] REQUEST_METHOD: `GET` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:05:20.762057 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-026c1133-1564-4e46-bacc-cb37cb5b47c3 None admin] SCRIPT_NAME: `/identity` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:05:20.762333 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-026c1133-1564-4e46-bacc-cb37cb5b47c3 None admin] PATH_INFO: `/v3/roles` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:05:20.763043 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-026c1133-1564-4e46-bacc-cb37cb5b47c3 None admin] RBAC: Adding query filter params (name=member) {{(pid=88551) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 19:05:20.763344 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-026c1133-1564-4e46-bacc-cb37cb5b47c3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:05:20.764760 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-026c1133-1564-4e46-bacc-cb37cb5b47c3 None admin] RBAC: Authorization granted {{(pid=88551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:05:20.769345 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2962592-a4e5-41c8-8699-0c484c07819d None admin] Validating token access rules against request {{(pid=88550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:05:20.773772 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: [pid: 88551|app: 0|req: 41/82] 10.222.0.26 () {56 vars in 1101 bytes} [Wed Aug 17 19:05:20 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 19:05:20.774423 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-026c1133-1564-4e46-bacc-cb37cb5b47c3 None admin] Authenticating user token {{(pid=88551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:05:20.804829 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-772289ae-9077-4053-997f-9d18ccd4326b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '819d41a279e64291acc60de51e1530ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:05:20.805453 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-772289ae-9077-4053-997f-9d18ccd4326b None admin] REQUEST_METHOD: `GET` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:05:20.805735 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-772289ae-9077-4053-997f-9d18ccd4326b None admin] SCRIPT_NAME: `/identity` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:05:20.806010 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-772289ae-9077-4053-997f-9d18ccd4326b None admin] PATH_INFO: `/v3/users/42ca546140f547848db6ed420a5044f3` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:05:20.807179 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-772289ae-9077-4053-997f-9d18ccd4326b None admin] RBAC: Authorizing `identity:get_user(user_id=42ca546140f547848db6ed420a5044f3)` {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:05:20.809053 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-772289ae-9077-4053-997f-9d18ccd4326b None admin] RBAC: Authorization granted {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:05:20.810667 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: [pid: 88550|app: 0|req: 42/83] 10.222.0.26 () {56 vars in 1177 bytes} [Wed Aug 17 19:05:20 2022] GET /identity/v3/users/42ca546140f547848db6ed420a5044f3 => generated 275 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 19:05:20.811422 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-772289ae-9077-4053-997f-9d18ccd4326b None admin] Authenticating user token {{(pid=88550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:05:20.863288 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG dbcounter [-] [88550] Writing DB stats keystone:SELECT=100 {{(pid=88550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:05:20.882868 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-026c1133-1564-4e46-bacc-cb37cb5b47c3 None admin] Validating token access rules against request {{(pid=88551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:05:20.912514 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG dbcounter [-] [88551] Writing DB stats keystone:SELECT=100 {{(pid=88551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:05:20.917290 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d808aea5-483b-410d-a294-c29fb7aba49d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '819d41a279e64291acc60de51e1530ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:05:20.917443 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-772289ae-9077-4053-997f-9d18ccd4326b None admin] Validating token access rules against request {{(pid=88550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:05:20.917900 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d808aea5-483b-410d-a294-c29fb7aba49d None admin] REQUEST_METHOD: `GET` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:05:20.918184 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d808aea5-483b-410d-a294-c29fb7aba49d None admin] SCRIPT_NAME: `/identity` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:05:20.918453 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d808aea5-483b-410d-a294-c29fb7aba49d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:05:20.953451 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c5d590a-679c-4614-83e1-6e7178a76e7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '819d41a279e64291acc60de51e1530ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:05:20.954062 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c5d590a-679c-4614-83e1-6e7178a76e7b None admin] REQUEST_METHOD: `POST` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:05:20.954341 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c5d590a-679c-4614-83e1-6e7178a76e7b None admin] SCRIPT_NAME: `/identity` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:05:20.954639 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c5d590a-679c-4614-83e1-6e7178a76e7b None admin] PATH_INFO: `/v3/users` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:05:20.955283 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c5d590a-679c-4614-83e1-6e7178a76e7b None admin] RBAC: Authorizing `identity:create_user()` {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:05:20.956720 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c5d590a-679c-4614-83e1-6e7178a76e7b None admin] RBAC: Authorization granted {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:05:20.990465 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d808aea5-483b-410d-a294-c29fb7aba49d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:05:20.991968 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d808aea5-483b-410d-a294-c29fb7aba49d None admin] RBAC: Authorization granted {{(pid=88551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:05:21.028063 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: [pid: 88550|app: 0|req: 43/84] 10.222.0.26 () {60 vars in 1132 bytes} [Wed Aug 17 19:05:20 2022] POST /identity/v3/users => generated 289 bytes in 217 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 19:05:21.028917 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c5d590a-679c-4614-83e1-6e7178a76e7b None admin] Authenticating user token {{(pid=88550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:05:21.101251 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: [pid: 88551|app: 0|req: 42/85] 10.222.0.26 () {58 vars in 1282 bytes} [Wed Aug 17 19:05:20 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 327 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 17 19:05:21.102809 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d808aea5-483b-410d-a294-c29fb7aba49d None admin] Authenticating user token {{(pid=88551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:05:21.140249 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG dbcounter [-] [88551] Writing DB stats keystone:SELECT=100 {{(pid=88551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:05:21.170682 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c5d590a-679c-4614-83e1-6e7178a76e7b None admin] Validating token access rules against request {{(pid=88550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:05:21.173748 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG dbcounter [-] [88550] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:05:21.213158 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-844a4d22-7c2f-44d6-a2c8-746c0fbad8df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '819d41a279e64291acc60de51e1530ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:05:21.213787 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-844a4d22-7c2f-44d6-a2c8-746c0fbad8df None admin] REQUEST_METHOD: `GET` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:05:21.214071 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-844a4d22-7c2f-44d6-a2c8-746c0fbad8df None admin] SCRIPT_NAME: `/identity` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:05:21.214350 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-844a4d22-7c2f-44d6-a2c8-746c0fbad8df None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:05:21.224805 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d808aea5-483b-410d-a294-c29fb7aba49d None admin] Validating token access rules against request {{(pid=88551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:05:21.270801 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a14ebf9e-259a-489d-84bd-15aa8dbd097b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '819d41a279e64291acc60de51e1530ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:05:21.271759 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a14ebf9e-259a-489d-84bd-15aa8dbd097b None admin] REQUEST_METHOD: `GET` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:05:21.271759 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a14ebf9e-259a-489d-84bd-15aa8dbd097b None admin] SCRIPT_NAME: `/identity` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:05:21.271759 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a14ebf9e-259a-489d-84bd-15aa8dbd097b None admin] PATH_INFO: `/v3/users/42ca546140f547848db6ed420a5044f3` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:05:21.271759 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a14ebf9e-259a-489d-84bd-15aa8dbd097b None admin] RBAC: Authorizing `identity:get_user(user_id=42ca546140f547848db6ed420a5044f3)` {{(pid=88551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:05:21.274727 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a14ebf9e-259a-489d-84bd-15aa8dbd097b None admin] RBAC: Authorization granted {{(pid=88551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:05:21.278646 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: [pid: 88551|app: 0|req: 43/86] 10.222.0.26 () {56 vars in 1177 bytes} [Wed Aug 17 19:05:21 2022] GET /identity/v3/users/42ca546140f547848db6ed420a5044f3 => generated 275 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 19:05:21.278646 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a14ebf9e-259a-489d-84bd-15aa8dbd097b None admin] Authenticating user token {{(pid=88551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:05:21.303908 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-844a4d22-7c2f-44d6-a2c8-746c0fbad8df None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:05:21.305578 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-844a4d22-7c2f-44d6-a2c8-746c0fbad8df None admin] RBAC: Authorization granted {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:05:21.407810 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a14ebf9e-259a-489d-84bd-15aa8dbd097b None admin] Validating token access rules against request {{(pid=88551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:05:21.410175 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG dbcounter [-] [88551] Writing DB stats keystone:SELECT=100 {{(pid=88551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:05:21.439469 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: [pid: 88550|app: 0|req: 44/87] 10.222.0.26 () {58 vars in 1282 bytes} [Wed Aug 17 19:05:21 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 411 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 17 19:05:21.440415 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-844a4d22-7c2f-44d6-a2c8-746c0fbad8df None admin] Authenticating user token {{(pid=88550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:05:21.443654 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG dbcounter [-] [88550] Writing DB stats keystone:SELECT=100 {{(pid=88550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:05:21.453961 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-302f2ac2-d3a1-45d8-b809-8fa606717401 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '819d41a279e64291acc60de51e1530ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:05:21.455024 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-302f2ac2-d3a1-45d8-b809-8fa606717401 None admin] REQUEST_METHOD: `GET` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:05:21.455313 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-302f2ac2-d3a1-45d8-b809-8fa606717401 None admin] SCRIPT_NAME: `/identity` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:05:21.455585 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-302f2ac2-d3a1-45d8-b809-8fa606717401 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:05:21.563858 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-844a4d22-7c2f-44d6-a2c8-746c0fbad8df None admin] Validating token access rules against request {{(pid=88550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:05:21.574575 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-302f2ac2-d3a1-45d8-b809-8fa606717401 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:05:21.576209 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-302f2ac2-d3a1-45d8-b809-8fa606717401 None admin] RBAC: Authorization granted {{(pid=88551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:05:21.602095 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1439ae4-463c-4171-88a3-edf367de0e7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '819d41a279e64291acc60de51e1530ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:05:21.602868 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1439ae4-463c-4171-88a3-edf367de0e7f None admin] REQUEST_METHOD: `GET` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:05:21.603157 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1439ae4-463c-4171-88a3-edf367de0e7f None admin] SCRIPT_NAME: `/identity` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:05:21.603540 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1439ae4-463c-4171-88a3-edf367de0e7f None admin] PATH_INFO: `/v3/projects/143eeb5624b2449582a0739926bcb8e1` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:05:21.604729 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1439ae4-463c-4171-88a3-edf367de0e7f None admin] RBAC: Authorizing `identity:get_project(project_id=143eeb5624b2449582a0739926bcb8e1)` {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:05:21.606321 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1439ae4-463c-4171-88a3-edf367de0e7f None admin] RBAC: Authorization granted {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:05:21.608287 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: [pid: 88550|app: 0|req: 45/88] 10.222.0.26 () {56 vars in 1186 bytes} [Wed Aug 17 19:05:21 2022] GET /identity/v3/projects/143eeb5624b2449582a0739926bcb8e1 => generated 298 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 19:05:21.609091 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1439ae4-463c-4171-88a3-edf367de0e7f None admin] Authenticating user token {{(pid=88550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:05:21.686805 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG dbcounter [-] [88550] Writing DB stats keystone:SELECT=100 {{(pid=88550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:05:21.691713 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG dbcounter [-] [88551] Writing DB stats keystone:SELECT=100 {{(pid=88551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:05:21.695707 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: [pid: 88551|app: 0|req: 44/89] 10.222.0.26 () {58 vars in 1282 bytes} [Wed Aug 17 19:05:21 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 419 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 17 19:05:21.696523 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-302f2ac2-d3a1-45d8-b809-8fa606717401 None admin] Authenticating user token {{(pid=88551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:05:21.727033 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1439ae4-463c-4171-88a3-edf367de0e7f None admin] Validating token access rules against request {{(pid=88550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:05:21.770016 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7093b51e-654c-4ad7-87dc-cd6ada0bc35e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '819d41a279e64291acc60de51e1530ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:05:21.770779 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7093b51e-654c-4ad7-87dc-cd6ada0bc35e None admin] REQUEST_METHOD: `GET` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:05:21.771244 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7093b51e-654c-4ad7-87dc-cd6ada0bc35e None admin] SCRIPT_NAME: `/identity` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:05:21.771591 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7093b51e-654c-4ad7-87dc-cd6ada0bc35e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:05:21.809673 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-302f2ac2-d3a1-45d8-b809-8fa606717401 None admin] Validating token access rules against request {{(pid=88551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:05:21.847234 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a158e35-27ca-4f54-b163-7c46e4a8f072 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '819d41a279e64291acc60de51e1530ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:05:21.847972 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a158e35-27ca-4f54-b163-7c46e4a8f072 None admin] REQUEST_METHOD: `GET` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:05:21.848256 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a158e35-27ca-4f54-b163-7c46e4a8f072 None admin] SCRIPT_NAME: `/identity` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:05:21.848526 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a158e35-27ca-4f54-b163-7c46e4a8f072 None admin] PATH_INFO: `/v3/projects/143eeb5624b2449582a0739926bcb8e1` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:05:21.849786 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a158e35-27ca-4f54-b163-7c46e4a8f072 None admin] RBAC: Authorizing `identity:get_project(project_id=143eeb5624b2449582a0739926bcb8e1)` {{(pid=88551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:05:21.851363 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a158e35-27ca-4f54-b163-7c46e4a8f072 None admin] RBAC: Authorization granted {{(pid=88551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:05:21.852279 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7093b51e-654c-4ad7-87dc-cd6ada0bc35e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:05:21.852948 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: [pid: 88551|app: 0|req: 45/90] 10.222.0.26 () {56 vars in 1186 bytes} [Wed Aug 17 19:05:21 2022] GET /identity/v3/projects/143eeb5624b2449582a0739926bcb8e1 => generated 298 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 19:05:21.857824 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a158e35-27ca-4f54-b163-7c46e4a8f072 None admin] Authenticating user token {{(pid=88551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:05:21.859833 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7093b51e-654c-4ad7-87dc-cd6ada0bc35e None admin] RBAC: Authorization granted {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:05:21.931309 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG dbcounter [-] [88551] Writing DB stats keystone:SELECT=100 {{(pid=88551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:05:21.949746 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG dbcounter [-] [88550] Writing DB stats keystone:SELECT=100 {{(pid=88550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:05:21.965974 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a158e35-27ca-4f54-b163-7c46e4a8f072 None admin] Validating token access rules against request {{(pid=88551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:05:21.987260 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: [pid: 88550|app: 0|req: 46/91] 10.222.0.26 () {58 vars in 1282 bytes} [Wed Aug 17 19:05:21 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 378 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 17 19:05:21.988564 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7093b51e-654c-4ad7-87dc-cd6ada0bc35e None admin] Authenticating user token {{(pid=88550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:05:22.007555 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de54e849-b7d1-47c8-a3b8-39c67dbc4851 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '819d41a279e64291acc60de51e1530ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:05:22.008149 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de54e849-b7d1-47c8-a3b8-39c67dbc4851 None admin] REQUEST_METHOD: `GET` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:05:22.008429 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de54e849-b7d1-47c8-a3b8-39c67dbc4851 None admin] SCRIPT_NAME: `/identity` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:05:22.008702 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de54e849-b7d1-47c8-a3b8-39c67dbc4851 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:05:22.009495 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de54e849-b7d1-47c8-a3b8-39c67dbc4851 None admin] RBAC: Adding query filter params (role.id=748773430faa4030989e1e77b3f361e1, scope.project.id=143eeb5624b2449582a0739926bcb8e1, user.id=42ca546140f547848db6ed420a5044f3) {{(pid=88551) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 19:05:22.009807 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de54e849-b7d1-47c8-a3b8-39c67dbc4851 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:05:22.011516 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de54e849-b7d1-47c8-a3b8-39c67dbc4851 None admin] RBAC: Authorization granted {{(pid=88551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:05:22.019822 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: [pid: 88551|app: 0|req: 46/92] 10.222.0.26 () {56 vars in 1374 bytes} [Wed Aug 17 19:05:21 2022] GET /identity/v3/role_assignments?user.id=42ca546140f547848db6ed420a5044f3&scope.project.id=143eeb5624b2449582a0739926bcb8e1&role.id=748773430faa4030989e1e77b3f361e1 => generated 259 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 19:05:22.027227 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de54e849-b7d1-47c8-a3b8-39c67dbc4851 None admin] Authenticating user token {{(pid=88551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:05:22.133498 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7093b51e-654c-4ad7-87dc-cd6ada0bc35e None admin] Validating token access rules against request {{(pid=88550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:05:22.159036 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de54e849-b7d1-47c8-a3b8-39c67dbc4851 None admin] Validating token access rules against request {{(pid=88551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:05:22.195994 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d561ba2-2082-4be4-870c-f1c82f6ee4a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '819d41a279e64291acc60de51e1530ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:05:22.197091 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d561ba2-2082-4be4-870c-f1c82f6ee4a9 None admin] REQUEST_METHOD: `GET` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:05:22.197603 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d561ba2-2082-4be4-870c-f1c82f6ee4a9 None admin] SCRIPT_NAME: `/identity` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:05:22.198079 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d561ba2-2082-4be4-870c-f1c82f6ee4a9 None admin] PATH_INFO: `/v3/projects/143eeb5624b2449582a0739926bcb8e1` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:05:22.199786 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d561ba2-2082-4be4-870c-f1c82f6ee4a9 None admin] RBAC: Authorizing `identity:get_project(project_id=143eeb5624b2449582a0739926bcb8e1)` {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:05:22.200267 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG dbcounter [-] [88551] Writing DB stats keystone:SELECT=100 {{(pid=88551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:05:22.202960 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d561ba2-2082-4be4-870c-f1c82f6ee4a9 None admin] RBAC: Authorization granted {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:05:22.205236 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: [pid: 88550|app: 0|req: 47/93] 10.222.0.26 () {56 vars in 1186 bytes} [Wed Aug 17 19:05:21 2022] GET /identity/v3/projects/143eeb5624b2449582a0739926bcb8e1 => generated 298 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 19:05:22.205683 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8344ca27-0e04-4411-b4b3-2dacb12248b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '819d41a279e64291acc60de51e1530ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:05:22.206360 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8344ca27-0e04-4411-b4b3-2dacb12248b7 None admin] REQUEST_METHOD: `GET` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:05:22.209892 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8344ca27-0e04-4411-b4b3-2dacb12248b7 None admin] SCRIPT_NAME: `/identity` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:05:22.209892 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8344ca27-0e04-4411-b4b3-2dacb12248b7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:05:22.209892 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8344ca27-0e04-4411-b4b3-2dacb12248b7 None admin] RBAC: Adding query filter params (role.id=204f62ae18174b60a2e3f5d4f28ea326, scope.project.id=143eeb5624b2449582a0739926bcb8e1, user.id=819d41a279e64291acc60de51e1530ae) {{(pid=88551) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 19:05:22.209892 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8344ca27-0e04-4411-b4b3-2dacb12248b7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:05:22.209892 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8344ca27-0e04-4411-b4b3-2dacb12248b7 None admin] RBAC: Authorization granted {{(pid=88551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:05:22.210953 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d561ba2-2082-4be4-870c-f1c82f6ee4a9 None admin] Authenticating user token {{(pid=88550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:05:22.221727 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: [pid: 88551|app: 0|req: 47/94] 10.222.0.26 () {56 vars in 1374 bytes} [Wed Aug 17 19:05:22 2022] GET /identity/v3/role_assignments?user.id=819d41a279e64291acc60de51e1530ae&scope.project.id=143eeb5624b2449582a0739926bcb8e1&role.id=204f62ae18174b60a2e3f5d4f28ea326 => generated 259 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 19:05:22.221727 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8344ca27-0e04-4411-b4b3-2dacb12248b7 None admin] Authenticating user token {{(pid=88551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:05:22.296123 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG dbcounter [-] [88550] Writing DB stats keystone:SELECT=100 {{(pid=88550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:05:22.346719 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8344ca27-0e04-4411-b4b3-2dacb12248b7 None admin] Validating token access rules against request {{(pid=88551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:05:22.399668 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d77c160c-0349-4a75-bc5e-8fefd7c1a29f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '819d41a279e64291acc60de51e1530ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:05:22.400493 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d77c160c-0349-4a75-bc5e-8fefd7c1a29f None admin] REQUEST_METHOD: `GET` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:05:22.400786 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d77c160c-0349-4a75-bc5e-8fefd7c1a29f None admin] SCRIPT_NAME: `/identity` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:05:22.401063 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d77c160c-0349-4a75-bc5e-8fefd7c1a29f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:05:22.402304 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d77c160c-0349-4a75-bc5e-8fefd7c1a29f None admin] RBAC: Adding query filter params (role.id=60df6490940943d3b281ddaab1b0b9f7, scope.project.id=143eeb5624b2449582a0739926bcb8e1, user.id=42ca546140f547848db6ed420a5044f3) {{(pid=88551) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 19:05:22.402443 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d77c160c-0349-4a75-bc5e-8fefd7c1a29f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:05:22.404116 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d77c160c-0349-4a75-bc5e-8fefd7c1a29f None admin] RBAC: Authorization granted {{(pid=88551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:05:22.409887 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d561ba2-2082-4be4-870c-f1c82f6ee4a9 None admin] Validating token access rules against request {{(pid=88550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:05:22.412159 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: [pid: 88551|app: 0|req: 48/95] 10.222.0.26 () {56 vars in 1374 bytes} [Wed Aug 17 19:05:22 2022] GET /identity/v3/role_assignments?user.id=42ca546140f547848db6ed420a5044f3&scope.project.id=143eeb5624b2449582a0739926bcb8e1&role.id=60df6490940943d3b281ddaab1b0b9f7 => generated 259 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 19:05:22.451332 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe35fbb5-2f44-4b47-8974-3ddfa6abbe8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '819d41a279e64291acc60de51e1530ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:05:22.452333 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe35fbb5-2f44-4b47-8974-3ddfa6abbe8b None admin] REQUEST_METHOD: `GET` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:05:22.453494 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe35fbb5-2f44-4b47-8974-3ddfa6abbe8b None admin] SCRIPT_NAME: `/identity` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:05:22.453968 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe35fbb5-2f44-4b47-8974-3ddfa6abbe8b None admin] PATH_INFO: `/v3/projects/977262cf031442a1bc34c590144079a1` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:05:22.455486 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe35fbb5-2f44-4b47-8974-3ddfa6abbe8b None admin] RBAC: Authorizing `identity:get_project(project_id=977262cf031442a1bc34c590144079a1)` {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:05:22.457256 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe35fbb5-2f44-4b47-8974-3ddfa6abbe8b None admin] RBAC: Authorization granted {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:05:22.459271 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: [pid: 88550|app: 0|req: 48/96] 10.222.0.26 () {56 vars in 1186 bytes} [Wed Aug 17 19:05:22 2022] GET /identity/v3/projects/977262cf031442a1bc34c590144079a1 => generated 312 bytes in 253 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 19:05:22.465549 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d77c160c-0349-4a75-bc5e-8fefd7c1a29f None admin] Authenticating user token {{(pid=88551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:05:22.563933 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG dbcounter [-] [88551] Writing DB stats keystone:SELECT=100 {{(pid=88551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:05:22.625619 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d77c160c-0349-4a75-bc5e-8fefd7c1a29f None admin] Validating token access rules against request {{(pid=88551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:05:22.680500 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68a508e2-7bbe-4f92-b920-041031dc6aa6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '819d41a279e64291acc60de51e1530ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:05:22.681132 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a508e2-7bbe-4f92-b920-041031dc6aa6 None admin] REQUEST_METHOD: `GET` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:05:22.681416 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a508e2-7bbe-4f92-b920-041031dc6aa6 None admin] SCRIPT_NAME: `/identity` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:05:22.681692 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a508e2-7bbe-4f92-b920-041031dc6aa6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:05:22.682440 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68a508e2-7bbe-4f92-b920-041031dc6aa6 None admin] RBAC: Adding query filter params (role.id=748773430faa4030989e1e77b3f361e1, scope.project.id=977262cf031442a1bc34c590144079a1, user.id=42ca546140f547848db6ed420a5044f3) {{(pid=88551) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 19:05:22.682777 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68a508e2-7bbe-4f92-b920-041031dc6aa6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:05:22.684505 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68a508e2-7bbe-4f92-b920-041031dc6aa6 None admin] RBAC: Authorization granted {{(pid=88551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:05:22.695260 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: [pid: 88551|app: 0|req: 49/97] 10.222.0.26 () {56 vars in 1374 bytes} [Wed Aug 17 19:05:22 2022] GET /identity/v3/role_assignments?user.id=42ca546140f547848db6ed420a5044f3&scope.project.id=977262cf031442a1bc34c590144079a1&role.id=748773430faa4030989e1e77b3f361e1 => generated 259 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 19:05:23.959442 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e3955ae-9a44-4753-937b-0034b2714b00 None None] REQUEST_METHOD: `GET` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:05:23.959921 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e3955ae-9a44-4753-937b-0034b2714b00 None None] SCRIPT_NAME: `/identity` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:05:23.959993 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e3955ae-9a44-4753-937b-0034b2714b00 None None] PATH_INFO: `/` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:05:23.961344 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: [pid: 88550|app: 0|req: 49/98] 10.222.0.26 () {54 vars in 927 bytes} [Wed Aug 17 19:05:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 19:05:23.970975 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a171b0-7613-4376-b559-62c8b64c79ae None None] REQUEST_METHOD: `POST` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:05:23.971445 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a171b0-7613-4376-b559-62c8b64c79ae None None] SCRIPT_NAME: `/identity` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:05:23.971738 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a171b0-7613-4376-b559-62c8b64c79ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:05:23.997685 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.auth.core [None req-76a171b0-7613-4376-b559-62c8b64c79ae None None] MFA Rules not processed for user `819d41a279e64291acc60de51e1530ae`. Rule list: `[]` (Enabled: `True`). {{(pid=88551) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 19:05:24.002858 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.common.fernet_utils [None req-76a171b0-7613-4376-b559-62c8b64c79ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:05:24.019231 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c8a89b6-77b6-4c24-b3c8-05f32e6a1b76 None None] REQUEST_METHOD: `GET` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:05:24.019528 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c8a89b6-77b6-4c24-b3c8-05f32e6a1b76 None None] SCRIPT_NAME: `/identity` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:05:24.019787 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c8a89b6-77b6-4c24-b3c8-05f32e6a1b76 None None] PATH_INFO: `/` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:05:24.021124 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: [pid: 88550|app: 0|req: 50/99] 10.222.0.26 () {54 vars in 927 bytes} [Wed Aug 17 19:05:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 19:05:24.026295 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50134e90-33cc-44ea-a97a-e9199d370a81 None None] REQUEST_METHOD: `POST` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:05:24.026618 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50134e90-33cc-44ea-a97a-e9199d370a81 None None] SCRIPT_NAME: `/identity` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:05:24.026899 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50134e90-33cc-44ea-a97a-e9199d370a81 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:05:24.063554 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.auth.core [None req-50134e90-33cc-44ea-a97a-e9199d370a81 None None] MFA Rules not processed for user `819d41a279e64291acc60de51e1530ae`. Rule list: `[]` (Enabled: `True`). {{(pid=88550) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 19:05:24.064785 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.common.fernet_utils [None req-50134e90-33cc-44ea-a97a-e9199d370a81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:05:24.118755 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: [pid: 88551|app: 0|req: 50/100] 10.222.0.26 () {58 vars in 1024 bytes} [Wed Aug 17 19:05:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 17 19:05:24.215187 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: [pid: 88550|app: 0|req: 51/101] 10.222.0.26 () {58 vars in 1024 bytes} [Wed Aug 17 19:05:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 17 19:05:24.600082 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76a171b0-7613-4376-b559-62c8b64c79ae None None] Authenticating user token {{(pid=88551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:05:24.669874 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG dbcounter [-] [88551] Writing DB stats keystone:SELECT=100 {{(pid=88551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:05:24.723983 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76a171b0-7613-4376-b559-62c8b64c79ae None None] Validating token access rules against request {{(pid=88551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:05:24.763312 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed8b2bba-552e-4e43-a8b3-a58f8a99fa66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '819d41a279e64291acc60de51e1530ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:05:24.763968 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed8b2bba-552e-4e43-a8b3-a58f8a99fa66 None admin] REQUEST_METHOD: `GET` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:05:24.764250 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed8b2bba-552e-4e43-a8b3-a58f8a99fa66 None admin] SCRIPT_NAME: `/identity` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:05:24.764524 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed8b2bba-552e-4e43-a8b3-a58f8a99fa66 None admin] PATH_INFO: `/v3/domains/default` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:05:24.766364 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed8b2bba-552e-4e43-a8b3-a58f8a99fa66 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=88551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:05:24.767979 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed8b2bba-552e-4e43-a8b3-a58f8a99fa66 None admin] RBAC: Authorization granted {{(pid=88551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:05:24.769671 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: [pid: 88551|app: 0|req: 51/102] 10.222.0.26 () {56 vars in 1108 bytes} [Wed Aug 17 19:05:24 2022] GET /identity/v3/domains/default => generated 199 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 19:05:24.775941 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50134e90-33cc-44ea-a97a-e9199d370a81 None None] Authenticating user token {{(pid=88550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:05:24.825690 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG dbcounter [-] [88550] Writing DB stats keystone:SELECT=100 {{(pid=88550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:05:24.865072 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed8b2bba-552e-4e43-a8b3-a58f8a99fa66 None admin] Authenticating user token {{(pid=88551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:05:24.911810 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50134e90-33cc-44ea-a97a-e9199d370a81 None None] Validating token access rules against request {{(pid=88550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:05:24.960811 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4da62fec-7b74-4059-826a-ecdea3601165 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '819d41a279e64291acc60de51e1530ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:05:24.961419 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da62fec-7b74-4059-826a-ecdea3601165 None admin] REQUEST_METHOD: `POST` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:05:24.961629 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da62fec-7b74-4059-826a-ecdea3601165 None admin] SCRIPT_NAME: `/identity` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:05:24.966562 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da62fec-7b74-4059-826a-ecdea3601165 None admin] PATH_INFO: `/v3/projects` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:05:24.966562 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4da62fec-7b74-4059-826a-ecdea3601165 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:05:24.966562 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4da62fec-7b74-4059-826a-ecdea3601165 None admin] RBAC: Authorization granted {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:05:25.052188 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed8b2bba-552e-4e43-a8b3-a58f8a99fa66 None admin] Validating token access rules against request {{(pid=88551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:05:25.080266 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG dbcounter [-] [88551] Writing DB stats keystone:SELECT=100 {{(pid=88551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:05:25.081300 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: [pid: 88550|app: 0|req: 52/103] 10.222.0.26 () {60 vars in 1141 bytes} [Wed Aug 17 19:05:24 2022] POST /identity/v3/projects => generated 302 bytes in 306 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 19:05:25.091274 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6175cf6b-72d9-4aeb-bcdf-b5770e30c722 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '819d41a279e64291acc60de51e1530ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:05:25.092068 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6175cf6b-72d9-4aeb-bcdf-b5770e30c722 None admin] REQUEST_METHOD: `GET` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:05:25.092446 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6175cf6b-72d9-4aeb-bcdf-b5770e30c722 None admin] SCRIPT_NAME: `/identity` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:05:25.092864 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6175cf6b-72d9-4aeb-bcdf-b5770e30c722 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:05:25.105448 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6175cf6b-72d9-4aeb-bcdf-b5770e30c722 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 17 19:05:25.111218 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application [None req-6175cf6b-72d9-4aeb-bcdf-b5770e30c722 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 17 19:05:25.111218 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 19:05:25.111218 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 19:05:25.111218 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 19:05:25.111218 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 19:05:25.111218 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 19:05:25.111218 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 19:05:25.111218 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 19:05:25.111218 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 19:05:25.111218 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 19:05:25.111218 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 19:05:25.111218 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 19:05:25.111218 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 17 19:05:25.111218 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 17 19:05:25.111218 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 17 19:05:25.111218 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 17 19:05:25.112161 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 17 19:05:25.112161 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 17 19:05:25.112161 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 17 19:05:25.112161 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 17 19:05:25.112161 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 19:05:25.112161 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 19:05:25.112161 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 19:05:25.112161 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 19:05:25.112161 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 19:05:25.112161 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 19:05:25.112161 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 19:05:25.112161 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application with Lock( Aug 17 19:05:25.112161 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 19:05:25.112161 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application return self._enter() Aug 17 19:05:25.112161 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 19:05:25.112161 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 19:05:25.112944 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 19:05:25.112944 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application return self.creator() Aug 17 19:05:25.112944 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 19:05:25.112944 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application created_value = creator( Aug 17 19:05:25.112944 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 17 19:05:25.112944 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 17 19:05:25.112944 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 17 19:05:25.112944 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 17 19:05:25.112944 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 17 19:05:25.112944 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 17 19:05:25.112944 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 17 19:05:25.112944 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application Aug 17 19:05:25.112944 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: [pid: 88551|app: 0|req: 52/104] 10.222.0.26 () {56 vars in 1099 bytes} [Wed Aug 17 19:05:24 2022] GET /identity/v3/roles/reader => generated 84 bytes in 248 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 19:05:25.124249 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4da62fec-7b74-4059-826a-ecdea3601165 None admin] Authenticating user token {{(pid=88550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:05:25.183109 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd56f9e-f03d-4cd1-b786-1e0062d9241e None None] REQUEST_METHOD: `GET` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:05:25.183417 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd56f9e-f03d-4cd1-b786-1e0062d9241e None None] SCRIPT_NAME: `/identity` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:05:25.184446 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd56f9e-f03d-4cd1-b786-1e0062d9241e None None] PATH_INFO: `/` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:05:25.186195 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: [pid: 88551|app: 0|req: 53/105] 10.222.0.26 () {54 vars in 927 bytes} [Wed Aug 17 19:05:25 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 19:05:25.192048 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd1083ed-be39-472e-8cf0-48b7b8b8599c None None] REQUEST_METHOD: `POST` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:05:25.192330 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd1083ed-be39-472e-8cf0-48b7b8b8599c None None] SCRIPT_NAME: `/identity` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:05:25.192605 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd1083ed-be39-472e-8cf0-48b7b8b8599c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:05:25.231831 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.auth.core [None req-cd1083ed-be39-472e-8cf0-48b7b8b8599c None None] MFA Rules not processed for user `819d41a279e64291acc60de51e1530ae`. Rule list: `[]` (Enabled: `True`). {{(pid=88551) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 19:05:25.233062 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.common.fernet_utils [None req-cd1083ed-be39-472e-8cf0-48b7b8b8599c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:05:25.310172 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG dbcounter [-] [88550] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:05:25.350743 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4da62fec-7b74-4059-826a-ecdea3601165 None admin] Validating token access rules against request {{(pid=88550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:05:25.393772 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c221ce1-877a-480b-8019-b48563183720 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '819d41a279e64291acc60de51e1530ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:05:25.394846 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c221ce1-877a-480b-8019-b48563183720 None admin] REQUEST_METHOD: `GET` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:05:25.395334 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c221ce1-877a-480b-8019-b48563183720 None admin] SCRIPT_NAME: `/identity` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:05:25.395807 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c221ce1-877a-480b-8019-b48563183720 None admin] PATH_INFO: `/v3/roles` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:05:25.396688 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c221ce1-877a-480b-8019-b48563183720 None admin] RBAC: Adding query filter params (name=reader) {{(pid=88550) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 19:05:25.397231 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c221ce1-877a-480b-8019-b48563183720 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:05:25.399045 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c221ce1-877a-480b-8019-b48563183720 None admin] RBAC: Authorization granted {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:05:25.410059 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: [pid: 88550|app: 0|req: 53/106] 10.222.0.26 () {56 vars in 1101 bytes} [Wed Aug 17 19:05:25 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 292 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 17 19:05:25.416873 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c221ce1-877a-480b-8019-b48563183720 None admin] Authenticating user token {{(pid=88550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:05:25.440803 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: [pid: 88551|app: 0|req: 54/107] 10.222.0.26 () {58 vars in 1024 bytes} [Wed Aug 17 19:05:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 250 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 17 19:05:25.526843 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c221ce1-877a-480b-8019-b48563183720 None admin] Validating token access rules against request {{(pid=88550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:05:25.626892 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14aa59a7-2783-474a-8678-3ca2447bc98d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '819d41a279e64291acc60de51e1530ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:05:25.627902 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14aa59a7-2783-474a-8678-3ca2447bc98d None admin] REQUEST_METHOD: `GET` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:05:25.628364 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14aa59a7-2783-474a-8678-3ca2447bc98d None admin] SCRIPT_NAME: `/identity` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:05:25.628806 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14aa59a7-2783-474a-8678-3ca2447bc98d None admin] PATH_INFO: `/v3/users/f87943b9197d404ab09ed28087048ce9` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:05:25.655457 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14aa59a7-2783-474a-8678-3ca2447bc98d None admin] RBAC: Authorizing `identity:get_user(user_id=f87943b9197d404ab09ed28087048ce9)` {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:05:25.657925 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14aa59a7-2783-474a-8678-3ca2447bc98d None admin] RBAC: Authorization granted {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:05:25.659968 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: [pid: 88550|app: 0|req: 54/108] 10.222.0.26 () {56 vars in 1177 bytes} [Wed Aug 17 19:05:25 2022] GET /identity/v3/users/f87943b9197d404ab09ed28087048ce9 => generated 289 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 19:05:25.665925 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd1083ed-be39-472e-8cf0-48b7b8b8599c None None] Authenticating user token {{(pid=88551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:05:25.803409 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd1083ed-be39-472e-8cf0-48b7b8b8599c None None] Validating token access rules against request {{(pid=88551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:05:25.822274 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG dbcounter [-] [88551] Writing DB stats keystone:SELECT=100 {{(pid=88551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:05:25.849774 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d77f5bcb-e999-4ff3-833e-610aa2128454 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '819d41a279e64291acc60de51e1530ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:05:25.850559 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d77f5bcb-e999-4ff3-833e-610aa2128454 None admin] REQUEST_METHOD: `GET` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:05:25.850845 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d77f5bcb-e999-4ff3-833e-610aa2128454 None admin] SCRIPT_NAME: `/identity` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:05:25.851169 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d77f5bcb-e999-4ff3-833e-610aa2128454 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:05:25.870702 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a65b9e15-709a-41bb-a531-7c7bee53509d None None] REQUEST_METHOD: `GET` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:05:25.871327 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a65b9e15-709a-41bb-a531-7c7bee53509d None None] SCRIPT_NAME: `/identity` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:05:25.871835 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a65b9e15-709a-41bb-a531-7c7bee53509d None None] PATH_INFO: `/` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:05:25.873846 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: [pid: 88550|app: 0|req: 55/109] 10.222.0.26 () {54 vars in 927 bytes} [Wed Aug 17 19:05:25 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 19:05:25.879405 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97488a90-535c-46d6-aee1-1582eec1216d None None] REQUEST_METHOD: `POST` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:05:25.880226 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97488a90-535c-46d6-aee1-1582eec1216d None None] SCRIPT_NAME: `/identity` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:05:25.880740 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97488a90-535c-46d6-aee1-1582eec1216d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:05:25.918790 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.auth.core [None req-97488a90-535c-46d6-aee1-1582eec1216d None None] MFA Rules not processed for user `819d41a279e64291acc60de51e1530ae`. Rule list: `[]` (Enabled: `True`). {{(pid=88550) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 19:05:25.920792 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.common.fernet_utils [None req-97488a90-535c-46d6-aee1-1582eec1216d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:05:25.925194 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG dbcounter [-] [88550] Writing DB stats keystone:SELECT=100 {{(pid=88550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:05:25.993717 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d77f5bcb-e999-4ff3-833e-610aa2128454 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:05:25.995259 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d77f5bcb-e999-4ff3-833e-610aa2128454 None admin] RBAC: Authorization granted {{(pid=88551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:05:26.072779 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: [pid: 88550|app: 0|req: 56/110] 10.222.0.26 () {58 vars in 1024 bytes} [Wed Aug 17 19:05:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 17 19:05:26.073643 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97488a90-535c-46d6-aee1-1582eec1216d None None] Authenticating user token {{(pid=88550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:05:26.184844 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: [pid: 88551|app: 0|req: 55/111] 10.222.0.26 () {58 vars in 1282 bytes} [Wed Aug 17 19:05:25 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 519 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 17 19:05:26.186024 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5858da5-b84d-4dd0-8d5e-61d2673d4ff7 None None] REQUEST_METHOD: `GET` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:05:26.186308 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5858da5-b84d-4dd0-8d5e-61d2673d4ff7 None None] SCRIPT_NAME: `/identity` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:05:26.186693 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5858da5-b84d-4dd0-8d5e-61d2673d4ff7 None None] PATH_INFO: `/` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:05:26.188699 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: [pid: 88551|app: 0|req: 56/112] 10.222.0.26 () {54 vars in 927 bytes} [Wed Aug 17 19:05:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 19:05:26.196242 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e9abc8d-8dc9-4a11-8504-89f5e8a84be8 None None] REQUEST_METHOD: `POST` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:05:26.196527 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e9abc8d-8dc9-4a11-8504-89f5e8a84be8 None None] SCRIPT_NAME: `/identity` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:05:26.196809 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e9abc8d-8dc9-4a11-8504-89f5e8a84be8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:05:26.221002 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.auth.core [None req-5e9abc8d-8dc9-4a11-8504-89f5e8a84be8 None None] MFA Rules not processed for user `819d41a279e64291acc60de51e1530ae`. Rule list: `[]` (Enabled: `True`). {{(pid=88551) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 19:05:26.222198 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.common.fernet_utils [None req-5e9abc8d-8dc9-4a11-8504-89f5e8a84be8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:05:26.223160 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97488a90-535c-46d6-aee1-1582eec1216d None None] Validating token access rules against request {{(pid=88550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:05:26.231579 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG dbcounter [-] [88551] Writing DB stats keystone:SELECT=100 {{(pid=88551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:05:26.273124 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69a88c9f-d0b7-4e70-97e5-d0658abe65f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '819d41a279e64291acc60de51e1530ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:05:26.274068 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a88c9f-d0b7-4e70-97e5-d0658abe65f8 None admin] REQUEST_METHOD: `GET` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:05:26.274521 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a88c9f-d0b7-4e70-97e5-d0658abe65f8 None admin] SCRIPT_NAME: `/identity` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:05:26.274853 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a88c9f-d0b7-4e70-97e5-d0658abe65f8 None admin] PATH_INFO: `/v3/roles/member` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:05:26.285102 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG dbcounter [-] [88550] Writing DB stats keystone:SELECT=100 {{(pid=88550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:05:26.290313 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69a88c9f-d0b7-4e70-97e5-d0658abe65f8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 17 19:05:26.298355 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application [None req-69a88c9f-d0b7-4e70-97e5-d0658abe65f8 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 17 19:05:26.298355 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 19:05:26.298355 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 19:05:26.298355 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 19:05:26.298355 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 19:05:26.298355 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 19:05:26.298355 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 19:05:26.298355 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 19:05:26.298355 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 19:05:26.298355 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 19:05:26.298355 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 19:05:26.298355 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 19:05:26.298355 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 17 19:05:26.298355 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 17 19:05:26.298355 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 17 19:05:26.298355 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 17 19:05:26.299407 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 17 19:05:26.299407 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 17 19:05:26.299407 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 17 19:05:26.299407 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 17 19:05:26.299407 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 19:05:26.299407 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 19:05:26.299407 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 19:05:26.299407 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 19:05:26.299407 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 19:05:26.299407 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 19:05:26.299407 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 19:05:26.299407 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application with Lock( Aug 17 19:05:26.299407 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 19:05:26.299407 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return self._enter() Aug 17 19:05:26.299407 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 19:05:26.299407 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 19:05:26.300294 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 19:05:26.300294 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return self.creator() Aug 17 19:05:26.300294 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 19:05:26.300294 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application created_value = creator( Aug 17 19:05:26.300294 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 17 19:05:26.300294 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 17 19:05:26.300294 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 17 19:05:26.300294 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 17 19:05:26.300294 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 17 19:05:26.300294 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 17 19:05:26.300294 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 17 19:05:26.300294 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application Aug 17 19:05:26.300294 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: [pid: 88550|app: 0|req: 57/113] 10.222.0.26 () {56 vars in 1099 bytes} [Wed Aug 17 19:05:26 2022] GET /identity/v3/roles/member => generated 84 bytes in 226 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 19:05:26.305848 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69a88c9f-d0b7-4e70-97e5-d0658abe65f8 None admin] Authenticating user token {{(pid=88550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:05:26.314511 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: [pid: 88551|app: 0|req: 57/114] 10.222.0.26 () {58 vars in 1024 bytes} [Wed Aug 17 19:05:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 17 19:05:26.316260 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14296caa-d60f-4faa-abb6-531bec801b4c None None] REQUEST_METHOD: `GET` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:05:26.316557 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14296caa-d60f-4faa-abb6-531bec801b4c None None] SCRIPT_NAME: `/identity` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:05:26.316836 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14296caa-d60f-4faa-abb6-531bec801b4c None None] PATH_INFO: `/` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:05:26.318210 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: [pid: 88551|app: 0|req: 58/115] 10.222.0.26 () {54 vars in 927 bytes} [Wed Aug 17 19:05:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 19:05:26.318982 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14296caa-d60f-4faa-abb6-531bec801b4c None None] Authenticating user token {{(pid=88551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:05:26.481026 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14296caa-d60f-4faa-abb6-531bec801b4c None None] Validating token access rules against request {{(pid=88551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:05:26.481341 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69a88c9f-d0b7-4e70-97e5-d0658abe65f8 None admin] Validating token access rules against request {{(pid=88550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:05:26.521517 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8ccbff7-3a4d-4899-885a-3759d640bb7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '819d41a279e64291acc60de51e1530ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:05:26.522269 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ccbff7-3a4d-4899-885a-3759d640bb7f None admin] REQUEST_METHOD: `GET` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:05:26.522592 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ccbff7-3a4d-4899-885a-3759d640bb7f None admin] SCRIPT_NAME: `/identity` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:05:26.522879 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ccbff7-3a4d-4899-885a-3759d640bb7f None admin] PATH_INFO: `/v3/roles` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:05:26.523547 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8ccbff7-3a4d-4899-885a-3759d640bb7f None admin] RBAC: Adding query filter params (name=member) {{(pid=88551) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 19:05:26.523847 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8ccbff7-3a4d-4899-885a-3759d640bb7f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:05:26.524660 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76c2f6b1-193a-4e84-a32a-af037e4bf05a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '819d41a279e64291acc60de51e1530ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:05:26.525240 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8ccbff7-3a4d-4899-885a-3759d640bb7f None admin] RBAC: Authorization granted {{(pid=88551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:05:26.525341 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c2f6b1-193a-4e84-a32a-af037e4bf05a None admin] REQUEST_METHOD: `GET` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:05:26.525597 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c2f6b1-193a-4e84-a32a-af037e4bf05a None admin] SCRIPT_NAME: `/identity` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:05:26.525937 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c2f6b1-193a-4e84-a32a-af037e4bf05a None admin] PATH_INFO: `/v3/projects/143eeb5624b2449582a0739926bcb8e1` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:05:26.527342 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76c2f6b1-193a-4e84-a32a-af037e4bf05a None admin] RBAC: Authorizing `identity:get_project(project_id=143eeb5624b2449582a0739926bcb8e1)` {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:05:26.529352 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76c2f6b1-193a-4e84-a32a-af037e4bf05a None admin] RBAC: Authorization granted {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:05:26.532505 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: [pid: 88550|app: 0|req: 58/116] 10.222.0.26 () {56 vars in 1186 bytes} [Wed Aug 17 19:05:26 2022] GET /identity/v3/projects/143eeb5624b2449582a0739926bcb8e1 => generated 298 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 19:05:26.533489 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79eb1398-c0e8-4c58-8cbf-8e8ec56fb625 None None] REQUEST_METHOD: `POST` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:05:26.533773 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79eb1398-c0e8-4c58-8cbf-8e8ec56fb625 None None] SCRIPT_NAME: `/identity` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:05:26.534046 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79eb1398-c0e8-4c58-8cbf-8e8ec56fb625 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:05:26.539991 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: [pid: 88551|app: 0|req: 59/117] 10.222.0.26 () {56 vars in 1101 bytes} [Wed Aug 17 19:05:26 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 19:05:26.540845 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8ccbff7-3a4d-4899-885a-3759d640bb7f None admin] Authenticating user token {{(pid=88551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:05:26.545433 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG dbcounter [-] [88551] Writing DB stats keystone:SELECT=100 {{(pid=88551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:05:26.557345 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.auth.core [None req-79eb1398-c0e8-4c58-8cbf-8e8ec56fb625 None None] MFA Rules not processed for user `819d41a279e64291acc60de51e1530ae`. Rule list: `[]` (Enabled: `True`). {{(pid=88550) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 19:05:26.559882 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.common.fernet_utils [None req-79eb1398-c0e8-4c58-8cbf-8e8ec56fb625 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:05:26.630305 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG dbcounter [-] [88550] Writing DB stats keystone:SELECT=100 {{(pid=88550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:05:26.638968 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: [pid: 88550|app: 0|req: 59/118] 10.222.0.26 () {58 vars in 1024 bytes} [Wed Aug 17 19:05:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 17 19:05:26.640264 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79eb1398-c0e8-4c58-8cbf-8e8ec56fb625 None None] Authenticating user token {{(pid=88550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:05:26.651087 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8ccbff7-3a4d-4899-885a-3759d640bb7f None admin] Validating token access rules against request {{(pid=88551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:05:26.688578 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91ae8cdb-8a14-415b-ae35-4ac404f887bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '819d41a279e64291acc60de51e1530ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:05:26.689268 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ae8cdb-8a14-415b-ae35-4ac404f887bf None admin] REQUEST_METHOD: `GET` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:05:26.689550 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ae8cdb-8a14-415b-ae35-4ac404f887bf None admin] SCRIPT_NAME: `/identity` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:05:26.689862 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ae8cdb-8a14-415b-ae35-4ac404f887bf None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:05:26.701339 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91ae8cdb-8a14-415b-ae35-4ac404f887bf None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 17 19:05:26.706820 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application [None req-91ae8cdb-8a14-415b-ae35-4ac404f887bf None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 17 19:05:26.706820 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 19:05:26.706820 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 19:05:26.706820 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 19:05:26.706820 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 19:05:26.706820 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 19:05:26.706820 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 19:05:26.706820 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 19:05:26.706820 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 19:05:26.706820 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 19:05:26.706820 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 19:05:26.706820 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 19:05:26.706820 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 17 19:05:26.706820 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 17 19:05:26.706820 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 17 19:05:26.706820 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 17 19:05:26.707702 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 17 19:05:26.707702 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 17 19:05:26.707702 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 17 19:05:26.707702 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 17 19:05:26.707702 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 19:05:26.707702 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 19:05:26.707702 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 19:05:26.707702 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 19:05:26.707702 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 19:05:26.707702 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 19:05:26.707702 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 19:05:26.707702 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application with Lock( Aug 17 19:05:26.707702 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 19:05:26.707702 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application return self._enter() Aug 17 19:05:26.707702 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 19:05:26.707702 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 19:05:26.708508 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 19:05:26.708508 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application return self.creator() Aug 17 19:05:26.708508 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 19:05:26.708508 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application created_value = creator( Aug 17 19:05:26.708508 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 17 19:05:26.708508 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 17 19:05:26.708508 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 17 19:05:26.708508 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 17 19:05:26.708508 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 17 19:05:26.708508 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 17 19:05:26.708508 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 17 19:05:26.708508 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application Aug 17 19:05:26.708508 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: [pid: 88551|app: 0|req: 60/119] 10.222.0.26 () {56 vars in 1096 bytes} [Wed Aug 17 19:05:26 2022] GET /identity/v3/roles/admin => generated 83 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 19:05:26.709135 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91ae8cdb-8a14-415b-ae35-4ac404f887bf None admin] Authenticating user token {{(pid=88551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:05:26.754144 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79eb1398-c0e8-4c58-8cbf-8e8ec56fb625 None None] Validating token access rules against request {{(pid=88550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:05:26.781220 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG dbcounter [-] [88551] Writing DB stats keystone:SELECT=100 {{(pid=88551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:05:26.791924 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8655c7dd-28dc-4529-9544-df2ee6a691e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '819d41a279e64291acc60de51e1530ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:05:26.792815 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8655c7dd-28dc-4529-9544-df2ee6a691e5 None admin] REQUEST_METHOD: `GET` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:05:26.793245 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8655c7dd-28dc-4529-9544-df2ee6a691e5 None admin] SCRIPT_NAME: `/identity` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:05:26.793991 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8655c7dd-28dc-4529-9544-df2ee6a691e5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:05:26.794794 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8655c7dd-28dc-4529-9544-df2ee6a691e5 None admin] RBAC: Adding query filter params (role.id=e46917e94e2e4018b346d95b26d804eb, scope.project.id=143eeb5624b2449582a0739926bcb8e1, user.id=f87943b9197d404ab09ed28087048ce9) {{(pid=88550) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 19:05:26.795254 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8655c7dd-28dc-4529-9544-df2ee6a691e5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:05:26.797455 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8655c7dd-28dc-4529-9544-df2ee6a691e5 None admin] RBAC: Authorization granted {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:05:26.804585 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: [pid: 88550|app: 0|req: 60/120] 10.222.0.26 () {56 vars in 1374 bytes} [Wed Aug 17 19:05:26 2022] GET /identity/v3/role_assignments?user.id=f87943b9197d404ab09ed28087048ce9&scope.project.id=143eeb5624b2449582a0739926bcb8e1&role.id=e46917e94e2e4018b346d95b26d804eb => generated 259 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 19:05:26.805719 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8655c7dd-28dc-4529-9544-df2ee6a691e5 None admin] Authenticating user token {{(pid=88550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:05:26.833141 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91ae8cdb-8a14-415b-ae35-4ac404f887bf None admin] Validating token access rules against request {{(pid=88551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:05:26.885848 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG dbcounter [-] [88550] Writing DB stats keystone:SELECT=100 {{(pid=88550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:05:26.936555 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8655c7dd-28dc-4529-9544-df2ee6a691e5 None admin] Validating token access rules against request {{(pid=88550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:05:26.971345 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c6d1494-7339-4df3-8f8d-07ab08f0cae5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '819d41a279e64291acc60de51e1530ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:05:26.972051 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c6d1494-7339-4df3-8f8d-07ab08f0cae5 None admin] REQUEST_METHOD: `GET` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:05:26.972298 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c6d1494-7339-4df3-8f8d-07ab08f0cae5 None admin] SCRIPT_NAME: `/identity` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:05:26.972570 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c6d1494-7339-4df3-8f8d-07ab08f0cae5 None admin] PATH_INFO: `/v3/users/42ca546140f547848db6ed420a5044f3` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:05:26.974774 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c6d1494-7339-4df3-8f8d-07ab08f0cae5 None admin] RBAC: Authorizing `identity:get_user(user_id=42ca546140f547848db6ed420a5044f3)` {{(pid=88551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:05:26.976364 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c6d1494-7339-4df3-8f8d-07ab08f0cae5 None admin] RBAC: Authorization granted {{(pid=88551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:05:26.977633 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebd68f62-c435-4011-99b2-74f2761eb123 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '819d41a279e64291acc60de51e1530ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:05:26.978398 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: [pid: 88551|app: 0|req: 61/121] 10.222.0.26 () {56 vars in 1177 bytes} [Wed Aug 17 19:05:26 2022] GET /identity/v3/users/42ca546140f547848db6ed420a5044f3 => generated 275 bytes in 270 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 19:05:26.978512 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd68f62-c435-4011-99b2-74f2761eb123 None admin] REQUEST_METHOD: `GET` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:05:26.978765 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd68f62-c435-4011-99b2-74f2761eb123 None admin] SCRIPT_NAME: `/identity` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:05:26.979257 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd68f62-c435-4011-99b2-74f2761eb123 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:05:26.984360 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c6d1494-7339-4df3-8f8d-07ab08f0cae5 None admin] Authenticating user token {{(pid=88551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:05:26.995994 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebd68f62-c435-4011-99b2-74f2761eb123 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 17 19:05:27.001902 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application [None req-ebd68f62-c435-4011-99b2-74f2761eb123 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 17 19:05:27.001902 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 19:05:27.001902 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 19:05:27.001902 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 19:05:27.001902 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 19:05:27.001902 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 19:05:27.001902 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 19:05:27.001902 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 19:05:27.001902 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 19:05:27.001902 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 19:05:27.001902 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 19:05:27.001902 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 19:05:27.001902 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 17 19:05:27.001902 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 17 19:05:27.001902 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 17 19:05:27.001902 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 17 19:05:27.002879 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 17 19:05:27.002879 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 17 19:05:27.002879 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 17 19:05:27.002879 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 17 19:05:27.002879 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 19:05:27.002879 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 19:05:27.002879 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 19:05:27.002879 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 19:05:27.002879 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 19:05:27.002879 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 19:05:27.002879 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 19:05:27.002879 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application with Lock( Aug 17 19:05:27.002879 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 19:05:27.002879 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return self._enter() Aug 17 19:05:27.002879 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 19:05:27.002879 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 19:05:27.003834 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 19:05:27.003834 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return self.creator() Aug 17 19:05:27.003834 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 19:05:27.003834 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application created_value = creator( Aug 17 19:05:27.003834 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 17 19:05:27.003834 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 17 19:05:27.003834 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 17 19:05:27.003834 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 17 19:05:27.003834 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 17 19:05:27.003834 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 17 19:05:27.003834 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 17 19:05:27.003834 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application Aug 17 19:05:27.003834 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: [pid: 88550|app: 0|req: 61/122] 10.222.0.26 () {56 vars in 1114 bytes} [Wed Aug 17 19:05:26 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 19:05:27.004527 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebd68f62-c435-4011-99b2-74f2761eb123 None admin] Authenticating user token {{(pid=88550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:05:27.131024 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebd68f62-c435-4011-99b2-74f2761eb123 None admin] Validating token access rules against request {{(pid=88550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:05:27.131816 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c6d1494-7339-4df3-8f8d-07ab08f0cae5 None admin] Validating token access rules against request {{(pid=88551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:05:27.155151 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG dbcounter [-] [88550] Writing DB stats keystone:SELECT=100 {{(pid=88550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:05:27.174087 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG dbcounter [-] [88551] Writing DB stats keystone:SELECT=100 {{(pid=88551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:05:27.178255 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-948c4152-caeb-476b-b7e4-5aefb1945dca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '819d41a279e64291acc60de51e1530ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:05:27.178987 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f63eff8c-4727-4b65-ba45-f1bd2c57cdac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '819d41a279e64291acc60de51e1530ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:05:27.179311 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-948c4152-caeb-476b-b7e4-5aefb1945dca None admin] REQUEST_METHOD: `GET` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:05:27.179596 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f63eff8c-4727-4b65-ba45-f1bd2c57cdac None admin] REQUEST_METHOD: `GET` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:05:27.179887 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f63eff8c-4727-4b65-ba45-f1bd2c57cdac None admin] SCRIPT_NAME: `/identity` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:05:27.180007 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-948c4152-caeb-476b-b7e4-5aefb1945dca None admin] SCRIPT_NAME: `/identity` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:05:27.180160 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f63eff8c-4727-4b65-ba45-f1bd2c57cdac None admin] PATH_INFO: `/v3/roles` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:05:27.180541 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-948c4152-caeb-476b-b7e4-5aefb1945dca None admin] PATH_INFO: `/v3/projects/143eeb5624b2449582a0739926bcb8e1` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:05:27.180831 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f63eff8c-4727-4b65-ba45-f1bd2c57cdac None admin] RBAC: Adding query filter params (name=admin) {{(pid=88551) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 19:05:27.181143 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f63eff8c-4727-4b65-ba45-f1bd2c57cdac None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:05:27.182213 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-948c4152-caeb-476b-b7e4-5aefb1945dca None admin] RBAC: Authorizing `identity:get_project(project_id=143eeb5624b2449582a0739926bcb8e1)` {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:05:27.182555 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f63eff8c-4727-4b65-ba45-f1bd2c57cdac None admin] RBAC: Authorization granted {{(pid=88551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:05:27.184576 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-948c4152-caeb-476b-b7e4-5aefb1945dca None admin] RBAC: Authorization granted {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:05:27.186840 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: [pid: 88550|app: 0|req: 62/123] 10.222.0.26 () {56 vars in 1186 bytes} [Wed Aug 17 19:05:27 2022] GET /identity/v3/projects/143eeb5624b2449582a0739926bcb8e1 => generated 298 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 19:05:27.187795 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-948c4152-caeb-476b-b7e4-5aefb1945dca None admin] Authenticating user token {{(pid=88550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:05:27.197097 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: [pid: 88551|app: 0|req: 62/124] 10.222.0.26 () {56 vars in 1099 bytes} [Wed Aug 17 19:05:26 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 19:05:27.197792 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f63eff8c-4727-4b65-ba45-f1bd2c57cdac None admin] Authenticating user token {{(pid=88551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:05:27.311675 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f63eff8c-4727-4b65-ba45-f1bd2c57cdac None admin] Validating token access rules against request {{(pid=88551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:05:27.332522 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-948c4152-caeb-476b-b7e4-5aefb1945dca None admin] Validating token access rules against request {{(pid=88550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:05:27.349765 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52b7c875-919e-4db5-9ff3-7703b8422585 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '819d41a279e64291acc60de51e1530ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:05:27.350401 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b7c875-919e-4db5-9ff3-7703b8422585 None admin] REQUEST_METHOD: `GET` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:05:27.350730 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b7c875-919e-4db5-9ff3-7703b8422585 None admin] SCRIPT_NAME: `/identity` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:05:27.351006 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b7c875-919e-4db5-9ff3-7703b8422585 None admin] PATH_INFO: `/v3/roles/member` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:05:27.362099 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52b7c875-919e-4db5-9ff3-7703b8422585 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 17 19:05:27.367071 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application [None req-52b7c875-919e-4db5-9ff3-7703b8422585 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 17 19:05:27.367071 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 19:05:27.367071 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 19:05:27.367071 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 19:05:27.367071 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 19:05:27.367071 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 19:05:27.367071 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 19:05:27.367071 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 19:05:27.367071 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 19:05:27.367071 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 19:05:27.367071 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 19:05:27.367071 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 19:05:27.367071 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 17 19:05:27.367071 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 17 19:05:27.367071 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 17 19:05:27.367071 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 17 19:05:27.368159 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 17 19:05:27.368159 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 17 19:05:27.368159 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 17 19:05:27.368159 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 17 19:05:27.368159 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 19:05:27.368159 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 19:05:27.368159 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 19:05:27.368159 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 19:05:27.368159 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 19:05:27.368159 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 19:05:27.368159 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 19:05:27.368159 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application with Lock( Aug 17 19:05:27.368159 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 19:05:27.368159 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application return self._enter() Aug 17 19:05:27.368159 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 19:05:27.368159 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 19:05:27.369038 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 19:05:27.369038 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application return self.creator() Aug 17 19:05:27.369038 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 19:05:27.369038 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application created_value = creator( Aug 17 19:05:27.369038 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 17 19:05:27.369038 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 17 19:05:27.369038 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 17 19:05:27.369038 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 17 19:05:27.369038 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 17 19:05:27.369038 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 17 19:05:27.369038 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 17 19:05:27.369038 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application Aug 17 19:05:27.369038 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: [pid: 88551|app: 0|req: 63/125] 10.222.0.26 () {56 vars in 1099 bytes} [Wed Aug 17 19:05:27 2022] GET /identity/v3/roles/member => generated 84 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 19:05:27.369038 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52b7c875-919e-4db5-9ff3-7703b8422585 None admin] Authenticating user token {{(pid=88551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:05:27.382633 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9183ace2-e7be-4c82-be47-db7892f413d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '819d41a279e64291acc60de51e1530ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:05:27.383403 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9183ace2-e7be-4c82-be47-db7892f413d6 None admin] REQUEST_METHOD: `GET` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:05:27.383795 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9183ace2-e7be-4c82-be47-db7892f413d6 None admin] SCRIPT_NAME: `/identity` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:05:27.384180 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9183ace2-e7be-4c82-be47-db7892f413d6 None admin] PATH_INFO: `/v3/roles` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:05:27.385346 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9183ace2-e7be-4c82-be47-db7892f413d6 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=88550) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 19:05:27.385346 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9183ace2-e7be-4c82-be47-db7892f413d6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:05:27.387076 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9183ace2-e7be-4c82-be47-db7892f413d6 None admin] RBAC: Authorization granted {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:05:27.397509 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: [pid: 88550|app: 0|req: 63/126] 10.222.0.26 () {56 vars in 1111 bytes} [Wed Aug 17 19:05:27 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 19:05:27.398631 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9183ace2-e7be-4c82-be47-db7892f413d6 None admin] Authenticating user token {{(pid=88550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:05:27.436265 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG dbcounter [-] [88551] Writing DB stats keystone:SELECT=100 {{(pid=88551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:05:27.458237 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG dbcounter [-] [88550] Writing DB stats keystone:SELECT=100 {{(pid=88550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:05:27.483482 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52b7c875-919e-4db5-9ff3-7703b8422585 None admin] Validating token access rules against request {{(pid=88551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:05:27.513674 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9183ace2-e7be-4c82-be47-db7892f413d6 None admin] Validating token access rules against request {{(pid=88550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:05:27.521009 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0435681-c971-43db-a46b-0f74e0a2c28d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '819d41a279e64291acc60de51e1530ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:05:27.521879 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0435681-c971-43db-a46b-0f74e0a2c28d None admin] REQUEST_METHOD: `PUT` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:05:27.522331 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0435681-c971-43db-a46b-0f74e0a2c28d None admin] SCRIPT_NAME: `/identity` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:05:27.522898 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0435681-c971-43db-a46b-0f74e0a2c28d None admin] PATH_INFO: `/v3/projects/143eeb5624b2449582a0739926bcb8e1/users/42ca546140f547848db6ed420a5044f3/roles/748773430faa4030989e1e77b3f361e1` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:05:27.525193 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0435681-c971-43db-a46b-0f74e0a2c28d None admin] RBAC: Authorizing `identity:create_grant(project_id=143eeb5624b2449582a0739926bcb8e1, user_id=42ca546140f547848db6ed420a5044f3, role_id=748773430faa4030989e1e77b3f361e1)` {{(pid=88551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:05:27.526859 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0435681-c971-43db-a46b-0f74e0a2c28d None admin] RBAC: Authorization granted {{(pid=88551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:05:27.552375 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25fb0403-bda3-40f8-aad2-6ffb9cdf4830 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '819d41a279e64291acc60de51e1530ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:05:27.553124 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25fb0403-bda3-40f8-aad2-6ffb9cdf4830 None admin] REQUEST_METHOD: `GET` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:05:27.553512 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25fb0403-bda3-40f8-aad2-6ffb9cdf4830 None admin] SCRIPT_NAME: `/identity` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:05:27.553866 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25fb0403-bda3-40f8-aad2-6ffb9cdf4830 None admin] PATH_INFO: `/v3/users/819d41a279e64291acc60de51e1530ae` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:05:27.555286 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25fb0403-bda3-40f8-aad2-6ffb9cdf4830 None admin] RBAC: Authorizing `identity:get_user(user_id=819d41a279e64291acc60de51e1530ae)` {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:05:27.556895 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25fb0403-bda3-40f8-aad2-6ffb9cdf4830 None admin] RBAC: Authorization granted {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:05:27.559135 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: [pid: 88550|app: 0|req: 64/127] 10.222.0.26 () {56 vars in 1177 bytes} [Wed Aug 17 19:05:27 2022] GET /identity/v3/users/819d41a279e64291acc60de51e1530ae => generated 247 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 19:05:27.559789 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25fb0403-bda3-40f8-aad2-6ffb9cdf4830 None admin] Authenticating user token {{(pid=88550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:05:27.610654 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: [pid: 88551|app: 0|req: 64/128] 10.222.0.26 () {58 vars in 1439 bytes} [Wed Aug 17 19:05:27 2022] PUT /identity/v3/projects/143eeb5624b2449582a0739926bcb8e1/users/42ca546140f547848db6ed420a5044f3/roles/748773430faa4030989e1e77b3f361e1 => generated 0 bytes in 242 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 19:05:27.618139 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0435681-c971-43db-a46b-0f74e0a2c28d None admin] Authenticating user token {{(pid=88551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:05:27.729242 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25fb0403-bda3-40f8-aad2-6ffb9cdf4830 None admin] Validating token access rules against request {{(pid=88550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:05:27.769344 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG dbcounter [-] [88550] Writing DB stats keystone:SELECT=100 {{(pid=88550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:05:27.819952 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ec2641c-407b-4775-be66-bcbbac2d4b6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '819d41a279e64291acc60de51e1530ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:05:27.820587 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec2641c-407b-4775-be66-bcbbac2d4b6f None admin] REQUEST_METHOD: `GET` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:05:27.820874 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec2641c-407b-4775-be66-bcbbac2d4b6f None admin] SCRIPT_NAME: `/identity` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:05:27.821152 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec2641c-407b-4775-be66-bcbbac2d4b6f None admin] PATH_INFO: `/v3/roles` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:05:27.821840 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ec2641c-407b-4775-be66-bcbbac2d4b6f None admin] RBAC: Adding query filter params (name=member) {{(pid=88550) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 19:05:27.822151 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ec2641c-407b-4775-be66-bcbbac2d4b6f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:05:27.823617 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ec2641c-407b-4775-be66-bcbbac2d4b6f None admin] RBAC: Authorization granted {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:05:27.834796 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0435681-c971-43db-a46b-0f74e0a2c28d None admin] Validating token access rules against request {{(pid=88551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:05:27.839295 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: [pid: 88550|app: 0|req: 65/129] 10.222.0.26 () {56 vars in 1101 bytes} [Wed Aug 17 19:05:27 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 280 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 19:05:27.845186 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ec2641c-407b-4775-be66-bcbbac2d4b6f None admin] Authenticating user token {{(pid=88550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:05:27.851484 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG dbcounter [-] [88551] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:05:27.876761 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7505961a-e3e6-4e82-ba17-018aeebcb15a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '819d41a279e64291acc60de51e1530ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:05:27.876761 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7505961a-e3e6-4e82-ba17-018aeebcb15a None admin] REQUEST_METHOD: `GET` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:05:27.876761 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7505961a-e3e6-4e82-ba17-018aeebcb15a None admin] SCRIPT_NAME: `/identity` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:05:27.876761 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7505961a-e3e6-4e82-ba17-018aeebcb15a None admin] PATH_INFO: `/v3/users/42ca546140f547848db6ed420a5044f3` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:05:27.877333 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7505961a-e3e6-4e82-ba17-018aeebcb15a None admin] RBAC: Authorizing `identity:get_user(user_id=42ca546140f547848db6ed420a5044f3)` {{(pid=88551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:05:27.878944 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7505961a-e3e6-4e82-ba17-018aeebcb15a None admin] RBAC: Authorization granted {{(pid=88551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:05:27.880739 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: [pid: 88551|app: 0|req: 65/130] 10.222.0.26 () {56 vars in 1177 bytes} [Wed Aug 17 19:05:27 2022] GET /identity/v3/users/42ca546140f547848db6ed420a5044f3 => generated 275 bytes in 270 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 19:05:27.881665 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7505961a-e3e6-4e82-ba17-018aeebcb15a None admin] Authenticating user token {{(pid=88551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:05:27.962882 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ec2641c-407b-4775-be66-bcbbac2d4b6f None admin] Validating token access rules against request {{(pid=88550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:05:28.000855 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91f89f43-2671-42d8-b1fe-42fd72ef61cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '819d41a279e64291acc60de51e1530ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:05:28.001510 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f89f43-2671-42d8-b1fe-42fd72ef61cc None admin] REQUEST_METHOD: `GET` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:05:28.001795 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f89f43-2671-42d8-b1fe-42fd72ef61cc None admin] SCRIPT_NAME: `/identity` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:05:28.002071 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f89f43-2671-42d8-b1fe-42fd72ef61cc None admin] PATH_INFO: `/v3/projects/143eeb5624b2449582a0739926bcb8e1` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:05:28.003280 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91f89f43-2671-42d8-b1fe-42fd72ef61cc None admin] RBAC: Authorizing `identity:get_project(project_id=143eeb5624b2449582a0739926bcb8e1)` {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:05:28.004771 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91f89f43-2671-42d8-b1fe-42fd72ef61cc None admin] RBAC: Authorization granted {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:05:28.006678 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: [pid: 88550|app: 0|req: 66/131] 10.222.0.26 () {56 vars in 1186 bytes} [Wed Aug 17 19:05:27 2022] GET /identity/v3/projects/143eeb5624b2449582a0739926bcb8e1 => generated 298 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 19:05:28.011465 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91f89f43-2671-42d8-b1fe-42fd72ef61cc None admin] Authenticating user token {{(pid=88550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:05:28.013542 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7505961a-e3e6-4e82-ba17-018aeebcb15a None admin] Validating token access rules against request {{(pid=88551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:05:28.061332 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7937f8b-904b-4712-8d94-6c6f87865b58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '819d41a279e64291acc60de51e1530ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:05:28.062637 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7937f8b-904b-4712-8d94-6c6f87865b58 None admin] REQUEST_METHOD: `GET` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:05:28.063030 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7937f8b-904b-4712-8d94-6c6f87865b58 None admin] SCRIPT_NAME: `/identity` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:05:28.063384 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7937f8b-904b-4712-8d94-6c6f87865b58 None admin] PATH_INFO: `/v3/users/42ca546140f547848db6ed420a5044f3` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:05:28.064699 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7937f8b-904b-4712-8d94-6c6f87865b58 None admin] RBAC: Authorizing `identity:get_user(user_id=42ca546140f547848db6ed420a5044f3)` {{(pid=88551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:05:28.066359 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7937f8b-904b-4712-8d94-6c6f87865b58 None admin] RBAC: Authorization granted {{(pid=88551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:05:28.066722 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG dbcounter [-] [88550] Writing DB stats keystone:SELECT=100 {{(pid=88550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:05:28.068652 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: [pid: 88551|app: 0|req: 66/132] 10.222.0.26 () {56 vars in 1177 bytes} [Wed Aug 17 19:05:27 2022] GET /identity/v3/users/42ca546140f547848db6ed420a5044f3 => generated 275 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 19:05:28.069406 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7937f8b-904b-4712-8d94-6c6f87865b58 None admin] Authenticating user token {{(pid=88551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:05:28.155612 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG dbcounter [-] [88551] Writing DB stats keystone:SELECT=100 {{(pid=88551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:05:28.162059 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91f89f43-2671-42d8-b1fe-42fd72ef61cc None admin] Validating token access rules against request {{(pid=88550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:05:28.214202 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eba188d-8ca2-45b7-ac6d-a721798ba7f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '819d41a279e64291acc60de51e1530ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:05:28.214888 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eba188d-8ca2-45b7-ac6d-a721798ba7f6 None admin] REQUEST_METHOD: `GET` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:05:28.215174 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eba188d-8ca2-45b7-ac6d-a721798ba7f6 None admin] SCRIPT_NAME: `/identity` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:05:28.215450 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eba188d-8ca2-45b7-ac6d-a721798ba7f6 None admin] PATH_INFO: `/v3/projects/143eeb5624b2449582a0739926bcb8e1` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:05:28.215980 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7937f8b-904b-4712-8d94-6c6f87865b58 None admin] Validating token access rules against request {{(pid=88551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:05:28.216596 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eba188d-8ca2-45b7-ac6d-a721798ba7f6 None admin] RBAC: Authorizing `identity:get_project(project_id=143eeb5624b2449582a0739926bcb8e1)` {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:05:28.218323 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eba188d-8ca2-45b7-ac6d-a721798ba7f6 None admin] RBAC: Authorization granted {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:05:28.220151 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: [pid: 88550|app: 0|req: 67/133] 10.222.0.26 () {56 vars in 1186 bytes} [Wed Aug 17 19:05:28 2022] GET /identity/v3/projects/143eeb5624b2449582a0739926bcb8e1 => generated 298 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 19:05:28.221004 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eba188d-8ca2-45b7-ac6d-a721798ba7f6 None admin] Authenticating user token {{(pid=88550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:05:28.256407 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6458ff17-af99-4330-adeb-947647b04f58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '819d41a279e64291acc60de51e1530ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:05:28.257485 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6458ff17-af99-4330-adeb-947647b04f58 None admin] REQUEST_METHOD: `PUT` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:05:28.258299 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6458ff17-af99-4330-adeb-947647b04f58 None admin] SCRIPT_NAME: `/identity` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:05:28.258977 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6458ff17-af99-4330-adeb-947647b04f58 None admin] PATH_INFO: `/v3/projects/143eeb5624b2449582a0739926bcb8e1/users/819d41a279e64291acc60de51e1530ae/roles/204f62ae18174b60a2e3f5d4f28ea326` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:05:28.261388 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6458ff17-af99-4330-adeb-947647b04f58 None admin] RBAC: Authorizing `identity:create_grant(project_id=143eeb5624b2449582a0739926bcb8e1, user_id=819d41a279e64291acc60de51e1530ae, role_id=204f62ae18174b60a2e3f5d4f28ea326)` {{(pid=88551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:05:28.263942 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6458ff17-af99-4330-adeb-947647b04f58 None admin] RBAC: Authorization granted {{(pid=88551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:05:28.332418 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eba188d-8ca2-45b7-ac6d-a721798ba7f6 None admin] Validating token access rules against request {{(pid=88550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:05:28.350146 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG dbcounter [-] [88550] Writing DB stats keystone:SELECT=100 {{(pid=88550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:05:28.369383 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: [pid: 88551|app: 0|req: 67/134] 10.222.0.26 () {58 vars in 1439 bytes} [Wed Aug 17 19:05:28 2022] PUT /identity/v3/projects/143eeb5624b2449582a0739926bcb8e1/users/819d41a279e64291acc60de51e1530ae/roles/204f62ae18174b60a2e3f5d4f28ea326 => generated 0 bytes in 300 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 19:05:28.370728 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a3c5b1-f9e1-4aba-8b77-545f9cf7e376 None None] REQUEST_METHOD: `GET` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:05:28.370968 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a3c5b1-f9e1-4aba-8b77-545f9cf7e376 None None] SCRIPT_NAME: `/identity` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:05:28.371245 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a3c5b1-f9e1-4aba-8b77-545f9cf7e376 None None] PATH_INFO: `/` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:05:28.373601 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: [pid: 88551|app: 0|req: 68/135] 10.222.0.26 () {54 vars in 927 bytes} [Wed Aug 17 19:05:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 19:05:28.374461 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2a3c5b1-f9e1-4aba-8b77-545f9cf7e376 None None] Authenticating user token {{(pid=88551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:05:28.380922 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-707fd0b3-c277-48b3-a5e8-f68091d254f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '819d41a279e64291acc60de51e1530ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:05:28.381585 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-707fd0b3-c277-48b3-a5e8-f68091d254f9 None admin] REQUEST_METHOD: `GET` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:05:28.381872 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-707fd0b3-c277-48b3-a5e8-f68091d254f9 None admin] SCRIPT_NAME: `/identity` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:05:28.382151 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-707fd0b3-c277-48b3-a5e8-f68091d254f9 None admin] PATH_INFO: `/v3/projects/977262cf031442a1bc34c590144079a1` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:05:28.384190 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-707fd0b3-c277-48b3-a5e8-f68091d254f9 None admin] RBAC: Authorizing `identity:get_project(project_id=977262cf031442a1bc34c590144079a1)` {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:05:28.385801 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-707fd0b3-c277-48b3-a5e8-f68091d254f9 None admin] RBAC: Authorization granted {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:05:28.396118 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: [pid: 88550|app: 0|req: 68/136] 10.222.0.26 () {56 vars in 1186 bytes} [Wed Aug 17 19:05:28 2022] GET /identity/v3/projects/977262cf031442a1bc34c590144079a1 => generated 312 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 19:05:28.397653 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce079e6-7a82-4fb1-8f0e-e6c9916c0144 None None] REQUEST_METHOD: `POST` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:05:28.397956 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce079e6-7a82-4fb1-8f0e-e6c9916c0144 None None] SCRIPT_NAME: `/identity` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:05:28.398232 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce079e6-7a82-4fb1-8f0e-e6c9916c0144 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:05:28.441977 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.auth.core [None req-0ce079e6-7a82-4fb1-8f0e-e6c9916c0144 None None] MFA Rules not processed for user `819d41a279e64291acc60de51e1530ae`. Rule list: `[]` (Enabled: `True`). {{(pid=88550) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 19:05:28.445465 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.common.fernet_utils [None req-0ce079e6-7a82-4fb1-8f0e-e6c9916c0144 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:05:28.583953 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: [pid: 88550|app: 0|req: 69/137] 10.222.0.26 () {58 vars in 1024 bytes} [Wed Aug 17 19:05:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 17 19:05:28.584772 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ce079e6-7a82-4fb1-8f0e-e6c9916c0144 None None] Authenticating user token {{(pid=88550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:05:28.602805 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2a3c5b1-f9e1-4aba-8b77-545f9cf7e376 None None] Validating token access rules against request {{(pid=88551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:05:28.620440 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG dbcounter [-] [88551] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:05:28.658197 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f7405d0-51ec-4397-b91f-56bcb24a4e54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '819d41a279e64291acc60de51e1530ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:05:28.659419 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f7405d0-51ec-4397-b91f-56bcb24a4e54 None admin] REQUEST_METHOD: `PUT` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:05:28.659884 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f7405d0-51ec-4397-b91f-56bcb24a4e54 None admin] SCRIPT_NAME: `/identity` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:05:28.660389 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f7405d0-51ec-4397-b91f-56bcb24a4e54 None admin] PATH_INFO: `/v3/projects/143eeb5624b2449582a0739926bcb8e1/users/42ca546140f547848db6ed420a5044f3/roles/60df6490940943d3b281ddaab1b0b9f7` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:05:28.663193 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f7405d0-51ec-4397-b91f-56bcb24a4e54 None admin] RBAC: Authorizing `identity:create_grant(project_id=143eeb5624b2449582a0739926bcb8e1, user_id=42ca546140f547848db6ed420a5044f3, role_id=60df6490940943d3b281ddaab1b0b9f7)` {{(pid=88551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:05:28.664947 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f7405d0-51ec-4397-b91f-56bcb24a4e54 None admin] RBAC: Authorization granted {{(pid=88551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:05:28.729166 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ce079e6-7a82-4fb1-8f0e-e6c9916c0144 None None] Validating token access rules against request {{(pid=88550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:05:28.741840 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: [pid: 88551|app: 0|req: 69/138] 10.222.0.26 () {58 vars in 1439 bytes} [Wed Aug 17 19:05:28 2022] PUT /identity/v3/projects/143eeb5624b2449582a0739926bcb8e1/users/42ca546140f547848db6ed420a5044f3/roles/60df6490940943d3b281ddaab1b0b9f7 => generated 0 bytes in 368 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 19:05:28.744958 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG dbcounter [-] [88550] Writing DB stats keystone:SELECT=100 {{(pid=88550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:05:28.767862 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a268bc6a-894f-4a06-8c7c-e0a2f80ba10f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '819d41a279e64291acc60de51e1530ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:05:28.768547 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a268bc6a-894f-4a06-8c7c-e0a2f80ba10f None admin] REQUEST_METHOD: `PUT` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:05:28.768827 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a268bc6a-894f-4a06-8c7c-e0a2f80ba10f None admin] SCRIPT_NAME: `/identity` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:05:28.769100 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a268bc6a-894f-4a06-8c7c-e0a2f80ba10f None admin] PATH_INFO: `/v3/projects/977262cf031442a1bc34c590144079a1/users/42ca546140f547848db6ed420a5044f3/roles/748773430faa4030989e1e77b3f361e1` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:05:28.771320 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a268bc6a-894f-4a06-8c7c-e0a2f80ba10f None admin] RBAC: Authorizing `identity:create_grant(project_id=977262cf031442a1bc34c590144079a1, user_id=42ca546140f547848db6ed420a5044f3, role_id=748773430faa4030989e1e77b3f361e1)` {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:05:28.772809 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a268bc6a-894f-4a06-8c7c-e0a2f80ba10f None admin] RBAC: Authorization granted {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:05:28.865160 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: [pid: 88550|app: 0|req: 70/139] 10.222.0.26 () {58 vars in 1439 bytes} [Wed Aug 17 19:05:28 2022] PUT /identity/v3/projects/977262cf031442a1bc34c590144079a1/users/42ca546140f547848db6ed420a5044f3/roles/748773430faa4030989e1e77b3f361e1 => generated 0 bytes in 281 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 19:05:29.178312 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f7405d0-51ec-4397-b91f-56bcb24a4e54 None admin] Authenticating user token {{(pid=88551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:05:29.308063 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f7405d0-51ec-4397-b91f-56bcb24a4e54 None admin] Validating token access rules against request {{(pid=88551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:05:29.348280 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603609ec-b0da-4270-9d02-ff1ff151e68e None None] REQUEST_METHOD: `GET` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:05:29.348791 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603609ec-b0da-4270-9d02-ff1ff151e68e None None] SCRIPT_NAME: `/identity` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:05:29.348887 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603609ec-b0da-4270-9d02-ff1ff151e68e None None] PATH_INFO: `/` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:05:29.350178 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: [pid: 88550|app: 0|req: 71/140] 10.222.0.26 () {54 vars in 927 bytes} [Wed Aug 17 19:05:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 19:05:29.355392 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d35ae8ec-cc3b-4ee5-a6df-5f179f0afe7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '819d41a279e64291acc60de51e1530ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:05:29.356306 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d35ae8ec-cc3b-4ee5-a6df-5f179f0afe7d None admin] REQUEST_METHOD: `GET` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:05:29.359772 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb64edeb-8020-47f0-80cd-358741f6ffc7 None None] REQUEST_METHOD: `POST` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:05:29.359896 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d35ae8ec-cc3b-4ee5-a6df-5f179f0afe7d None admin] SCRIPT_NAME: `/identity` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:05:29.359971 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb64edeb-8020-47f0-80cd-358741f6ffc7 None None] SCRIPT_NAME: `/identity` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:05:29.360039 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d35ae8ec-cc3b-4ee5-a6df-5f179f0afe7d None admin] PATH_INFO: `/v3/domains/default` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:05:29.360104 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb64edeb-8020-47f0-80cd-358741f6ffc7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:05:29.360168 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d35ae8ec-cc3b-4ee5-a6df-5f179f0afe7d None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=88551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:05:29.361176 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d35ae8ec-cc3b-4ee5-a6df-5f179f0afe7d None admin] RBAC: Authorization granted {{(pid=88551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:05:29.363454 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: [pid: 88551|app: 0|req: 70/141] 10.222.0.26 () {56 vars in 1108 bytes} [Wed Aug 17 19:05:29 2022] GET /identity/v3/domains/default => generated 199 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 19:05:29.370468 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d35ae8ec-cc3b-4ee5-a6df-5f179f0afe7d None admin] Authenticating user token {{(pid=88551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:05:29.390594 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.auth.core [None req-cb64edeb-8020-47f0-80cd-358741f6ffc7 None None] MFA Rules not processed for user `819d41a279e64291acc60de51e1530ae`. Rule list: `[]` (Enabled: `True`). {{(pid=88550) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 19:05:29.390594 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.common.fernet_utils [None req-cb64edeb-8020-47f0-80cd-358741f6ffc7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:05:29.442652 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG dbcounter [-] [88551] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:05:29.470415 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: [pid: 88550|app: 0|req: 72/142] 10.222.0.26 () {58 vars in 1024 bytes} [Wed Aug 17 19:05:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 17 19:05:29.565617 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d35ae8ec-cc3b-4ee5-a6df-5f179f0afe7d None admin] Validating token access rules against request {{(pid=88551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:05:29.615241 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-059291f5-4394-4713-bc8b-4d44797d37ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '819d41a279e64291acc60de51e1530ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:05:29.616166 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-059291f5-4394-4713-bc8b-4d44797d37ca None admin] REQUEST_METHOD: `POST` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:05:29.616654 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-059291f5-4394-4713-bc8b-4d44797d37ca None admin] SCRIPT_NAME: `/identity` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:05:29.617107 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-059291f5-4394-4713-bc8b-4d44797d37ca None admin] PATH_INFO: `/v3/users` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:05:29.617938 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-059291f5-4394-4713-bc8b-4d44797d37ca None admin] RBAC: Authorizing `identity:create_user()` {{(pid=88551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:05:29.619605 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-059291f5-4394-4713-bc8b-4d44797d37ca None admin] RBAC: Authorization granted {{(pid=88551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:05:29.721651 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: [pid: 88551|app: 0|req: 71/143] 10.222.0.26 () {60 vars in 1132 bytes} [Wed Aug 17 19:05:29 2022] POST /identity/v3/users => generated 283 bytes in 352 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 17 19:05:29.882818 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb64edeb-8020-47f0-80cd-358741f6ffc7 None None] Authenticating user token {{(pid=88550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:05:30.027311 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb64edeb-8020-47f0-80cd-358741f6ffc7 None None] Validating token access rules against request {{(pid=88550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:05:30.029978 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG dbcounter [-] [88550] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:05:30.067212 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-135501f4-b830-4164-b752-25d1f4191549 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '819d41a279e64291acc60de51e1530ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:05:30.067868 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-135501f4-b830-4164-b752-25d1f4191549 None admin] REQUEST_METHOD: `GET` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:05:30.068149 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-135501f4-b830-4164-b752-25d1f4191549 None admin] SCRIPT_NAME: `/identity` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:05:30.068437 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-135501f4-b830-4164-b752-25d1f4191549 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:05:30.081661 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-135501f4-b830-4164-b752-25d1f4191549 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 17 19:05:30.088456 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application [None req-135501f4-b830-4164-b752-25d1f4191549 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 17 19:05:30.088456 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 19:05:30.088456 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 19:05:30.088456 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 19:05:30.088456 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 19:05:30.088456 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 19:05:30.088456 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 19:05:30.088456 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 19:05:30.088456 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 19:05:30.088456 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 19:05:30.088456 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 19:05:30.088456 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 19:05:30.088456 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 17 19:05:30.088456 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 17 19:05:30.088456 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 17 19:05:30.088456 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 17 19:05:30.089338 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 17 19:05:30.089338 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 17 19:05:30.089338 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 17 19:05:30.089338 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 17 19:05:30.089338 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 19:05:30.089338 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 19:05:30.089338 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 19:05:30.089338 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 19:05:30.089338 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 19:05:30.089338 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 19:05:30.089338 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 19:05:30.089338 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application with Lock( Aug 17 19:05:30.089338 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 19:05:30.089338 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return self._enter() Aug 17 19:05:30.089338 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 19:05:30.089338 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 19:05:30.090675 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 19:05:30.090675 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return self.creator() Aug 17 19:05:30.090675 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 19:05:30.090675 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application created_value = creator( Aug 17 19:05:30.090675 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 17 19:05:30.090675 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 17 19:05:30.090675 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 17 19:05:30.090675 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 17 19:05:30.090675 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 17 19:05:30.090675 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 17 19:05:30.090675 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 17 19:05:30.090675 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application Aug 17 19:05:30.090675 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: [pid: 88550|app: 0|req: 73/144] 10.222.0.26 () {56 vars in 1099 bytes} [Wed Aug 17 19:05:29 2022] GET /identity/v3/roles/reader => generated 84 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 19:05:30.099701 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-059291f5-4394-4713-bc8b-4d44797d37ca None admin] Authenticating user token {{(pid=88551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:05:30.254257 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG dbcounter [-] [88551] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:05:30.261234 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-059291f5-4394-4713-bc8b-4d44797d37ca None admin] Validating token access rules against request {{(pid=88551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:05:30.297662 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bce7ce88-6ba1-461f-8023-341067aad599 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '819d41a279e64291acc60de51e1530ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:05:30.298418 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce7ce88-6ba1-461f-8023-341067aad599 None admin] REQUEST_METHOD: `GET` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:05:30.302943 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce7ce88-6ba1-461f-8023-341067aad599 None admin] SCRIPT_NAME: `/identity` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:05:30.303225 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce7ce88-6ba1-461f-8023-341067aad599 None admin] PATH_INFO: `/v3/roles` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:05:30.303921 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bce7ce88-6ba1-461f-8023-341067aad599 None admin] RBAC: Adding query filter params (name=reader) {{(pid=88551) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 19:05:30.304232 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bce7ce88-6ba1-461f-8023-341067aad599 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:05:30.305613 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bce7ce88-6ba1-461f-8023-341067aad599 None admin] RBAC: Authorization granted {{(pid=88551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:05:30.315336 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: [pid: 88551|app: 0|req: 72/145] 10.222.0.26 () {56 vars in 1101 bytes} [Wed Aug 17 19:05:30 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 19:05:30.321448 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-135501f4-b830-4164-b752-25d1f4191549 None admin] Authenticating user token {{(pid=88550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:05:30.457292 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-135501f4-b830-4164-b752-25d1f4191549 None admin] Validating token access rules against request {{(pid=88550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:05:30.499863 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbf32775-d8d8-4ce3-aaa2-aa7f710cebe2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '819d41a279e64291acc60de51e1530ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:05:30.500576 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf32775-d8d8-4ce3-aaa2-aa7f710cebe2 None admin] REQUEST_METHOD: `GET` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:05:30.500797 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf32775-d8d8-4ce3-aaa2-aa7f710cebe2 None admin] SCRIPT_NAME: `/identity` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:05:30.501076 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf32775-d8d8-4ce3-aaa2-aa7f710cebe2 None admin] PATH_INFO: `/v3/users/f87943b9197d404ab09ed28087048ce9` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:05:30.506621 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbf32775-d8d8-4ce3-aaa2-aa7f710cebe2 None admin] RBAC: Authorizing `identity:get_user(user_id=f87943b9197d404ab09ed28087048ce9)` {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:05:30.506621 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbf32775-d8d8-4ce3-aaa2-aa7f710cebe2 None admin] RBAC: Authorization granted {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:05:30.506621 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: [pid: 88550|app: 0|req: 74/146] 10.222.0.26 () {56 vars in 1177 bytes} [Wed Aug 17 19:05:30 2022] GET /identity/v3/users/f87943b9197d404ab09ed28087048ce9 => generated 289 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 19:05:30.518205 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bce7ce88-6ba1-461f-8023-341067aad599 None admin] Authenticating user token {{(pid=88551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:05:30.664576 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bce7ce88-6ba1-461f-8023-341067aad599 None admin] Validating token access rules against request {{(pid=88551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:05:30.704480 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02fb73db-b196-48bb-900f-984341481670 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '819d41a279e64291acc60de51e1530ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:05:30.705113 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02fb73db-b196-48bb-900f-984341481670 None admin] REQUEST_METHOD: `GET` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:05:30.705388 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02fb73db-b196-48bb-900f-984341481670 None admin] SCRIPT_NAME: `/identity` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:05:30.705657 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02fb73db-b196-48bb-900f-984341481670 None admin] PATH_INFO: `/v3/projects/143eeb5624b2449582a0739926bcb8e1` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:05:30.706872 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02fb73db-b196-48bb-900f-984341481670 None admin] RBAC: Authorizing `identity:get_project(project_id=143eeb5624b2449582a0739926bcb8e1)` {{(pid=88551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:05:30.708430 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02fb73db-b196-48bb-900f-984341481670 None admin] RBAC: Authorization granted {{(pid=88551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:05:30.710368 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: [pid: 88551|app: 0|req: 73/147] 10.222.0.26 () {56 vars in 1186 bytes} [Wed Aug 17 19:05:30 2022] GET /identity/v3/projects/143eeb5624b2449582a0739926bcb8e1 => generated 298 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 19:05:30.710506 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c945dea4-963d-41c4-adcc-b4a05177907f None None] REQUEST_METHOD: `GET` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:05:30.710986 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c945dea4-963d-41c4-adcc-b4a05177907f None None] SCRIPT_NAME: `/identity` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:05:30.711339 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c945dea4-963d-41c4-adcc-b4a05177907f None None] PATH_INFO: `/` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:05:30.712727 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: [pid: 88550|app: 0|req: 75/148] 10.222.0.26 () {54 vars in 927 bytes} [Wed Aug 17 19:05:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 19:05:30.717310 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02fb73db-b196-48bb-900f-984341481670 None admin] Authenticating user token {{(pid=88551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:05:30.732228 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-378e28b5-add5-44d9-8691-0b5d73dc3c9a None None] REQUEST_METHOD: `POST` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:05:30.733855 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-378e28b5-add5-44d9-8691-0b5d73dc3c9a None None] SCRIPT_NAME: `/identity` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:05:30.734152 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-378e28b5-add5-44d9-8691-0b5d73dc3c9a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:05:30.764612 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG dbcounter [-] [88551] Writing DB stats keystone:SELECT=100 {{(pid=88551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:05:30.772174 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.auth.core [None req-378e28b5-add5-44d9-8691-0b5d73dc3c9a None None] MFA Rules not processed for user `819d41a279e64291acc60de51e1530ae`. Rule list: `[]` (Enabled: `True`). {{(pid=88550) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 19:05:30.778271 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.common.fernet_utils [None req-378e28b5-add5-44d9-8691-0b5d73dc3c9a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:05:30.833381 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG dbcounter [-] [88550] Writing DB stats keystone:SELECT=100 {{(pid=88550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:05:30.905603 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02fb73db-b196-48bb-900f-984341481670 None admin] Validating token access rules against request {{(pid=88551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:05:30.935980 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: [pid: 88550|app: 0|req: 76/149] 10.222.0.26 () {58 vars in 1024 bytes} [Wed Aug 17 19:05:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 205 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 17 19:05:30.975532 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b8e7634-7984-46d6-a5cc-d28d23648bc2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '819d41a279e64291acc60de51e1530ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:05:30.976216 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b8e7634-7984-46d6-a5cc-d28d23648bc2 None admin] REQUEST_METHOD: `PUT` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:05:30.976498 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b8e7634-7984-46d6-a5cc-d28d23648bc2 None admin] SCRIPT_NAME: `/identity` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:05:30.976793 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b8e7634-7984-46d6-a5cc-d28d23648bc2 None admin] PATH_INFO: `/v3/projects/143eeb5624b2449582a0739926bcb8e1/users/f87943b9197d404ab09ed28087048ce9/roles/e46917e94e2e4018b346d95b26d804eb` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:05:30.979356 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b8e7634-7984-46d6-a5cc-d28d23648bc2 None admin] RBAC: Authorizing `identity:create_grant(project_id=143eeb5624b2449582a0739926bcb8e1, user_id=f87943b9197d404ab09ed28087048ce9, role_id=e46917e94e2e4018b346d95b26d804eb)` {{(pid=88551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:05:30.980834 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b8e7634-7984-46d6-a5cc-d28d23648bc2 None admin] RBAC: Authorization granted {{(pid=88551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:05:31.092430 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: [pid: 88551|app: 0|req: 74/150] 10.222.0.26 () {58 vars in 1439 bytes} [Wed Aug 17 19:05:30 2022] PUT /identity/v3/projects/143eeb5624b2449582a0739926bcb8e1/users/f87943b9197d404ab09ed28087048ce9/roles/e46917e94e2e4018b346d95b26d804eb => generated 0 bytes in 375 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 19:05:31.326748 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd83d6ac-151e-4438-90a4-73e5e032d5c8 None None] REQUEST_METHOD: `GET` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:05:31.328059 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd83d6ac-151e-4438-90a4-73e5e032d5c8 None None] SCRIPT_NAME: `/identity` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:05:31.328550 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd83d6ac-151e-4438-90a4-73e5e032d5c8 None None] PATH_INFO: `/` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:05:31.330112 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: [pid: 88550|app: 0|req: 77/151] 10.222.0.26 () {54 vars in 927 bytes} [Wed Aug 17 19:05:31 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 19:05:31.336425 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4783a82f-04b4-4295-964c-530b569484b1 None None] REQUEST_METHOD: `POST` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:05:31.337356 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4783a82f-04b4-4295-964c-530b569484b1 None None] SCRIPT_NAME: `/identity` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:05:31.337836 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4783a82f-04b4-4295-964c-530b569484b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:05:31.366503 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.auth.core [None req-4783a82f-04b4-4295-964c-530b569484b1 None None] MFA Rules not processed for user `819d41a279e64291acc60de51e1530ae`. Rule list: `[]` (Enabled: `True`). {{(pid=88551) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 19:05:31.367825 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.common.fernet_utils [None req-4783a82f-04b4-4295-964c-530b569484b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:05:31.461809 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: [pid: 88551|app: 0|req: 75/152] 10.222.0.26 () {58 vars in 1024 bytes} [Wed Aug 17 19:05:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 17 19:05:31.552845 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd83d6ac-151e-4438-90a4-73e5e032d5c8 None None] Authenticating user token {{(pid=88550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:05:31.684532 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd83d6ac-151e-4438-90a4-73e5e032d5c8 None None] Validating token access rules against request {{(pid=88550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:05:31.728063 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af91ce94-f2a0-4656-8a81-9bcf08a7bcd0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '819d41a279e64291acc60de51e1530ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:05:31.728699 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af91ce94-f2a0-4656-8a81-9bcf08a7bcd0 None admin] REQUEST_METHOD: `GET` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:05:31.728976 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af91ce94-f2a0-4656-8a81-9bcf08a7bcd0 None admin] SCRIPT_NAME: `/identity` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:05:31.729246 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af91ce94-f2a0-4656-8a81-9bcf08a7bcd0 None admin] PATH_INFO: `/v3/roles/member` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:05:31.741397 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af91ce94-f2a0-4656-8a81-9bcf08a7bcd0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 17 19:05:31.746327 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application [None req-af91ce94-f2a0-4656-8a81-9bcf08a7bcd0 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 17 19:05:31.746327 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 19:05:31.746327 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 19:05:31.746327 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 19:05:31.746327 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 19:05:31.746327 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 19:05:31.746327 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 19:05:31.746327 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 19:05:31.746327 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 19:05:31.746327 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 19:05:31.746327 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 19:05:31.746327 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 19:05:31.746327 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 17 19:05:31.746327 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 17 19:05:31.746327 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 17 19:05:31.746327 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 17 19:05:31.747284 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 17 19:05:31.747284 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 17 19:05:31.747284 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 17 19:05:31.747284 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 17 19:05:31.747284 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 19:05:31.747284 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 19:05:31.747284 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 19:05:31.747284 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 19:05:31.747284 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 19:05:31.747284 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 19:05:31.747284 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 19:05:31.747284 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application with Lock( Aug 17 19:05:31.747284 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 19:05:31.747284 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return self._enter() Aug 17 19:05:31.747284 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 19:05:31.747284 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 19:05:31.748097 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 19:05:31.748097 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return self.creator() Aug 17 19:05:31.748097 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 19:05:31.748097 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application created_value = creator( Aug 17 19:05:31.748097 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 17 19:05:31.748097 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 17 19:05:31.748097 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 17 19:05:31.748097 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 17 19:05:31.748097 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 17 19:05:31.748097 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 17 19:05:31.748097 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 17 19:05:31.748097 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application Aug 17 19:05:31.748097 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: [pid: 88550|app: 0|req: 78/153] 10.222.0.26 () {56 vars in 1099 bytes} [Wed Aug 17 19:05:31 2022] GET /identity/v3/roles/member => generated 84 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 19:05:31.754342 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4783a82f-04b4-4295-964c-530b569484b1 None None] Authenticating user token {{(pid=88551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:05:31.771525 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG dbcounter [-] [88551] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:05:31.868873 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4783a82f-04b4-4295-964c-530b569484b1 None None] Validating token access rules against request {{(pid=88551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:05:31.914471 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70f28724-ad8b-4a76-8811-5ed4aef5c3d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '819d41a279e64291acc60de51e1530ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:05:31.915110 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f28724-ad8b-4a76-8811-5ed4aef5c3d8 None admin] REQUEST_METHOD: `GET` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:05:31.915382 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f28724-ad8b-4a76-8811-5ed4aef5c3d8 None admin] SCRIPT_NAME: `/identity` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:05:31.915652 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f28724-ad8b-4a76-8811-5ed4aef5c3d8 None admin] PATH_INFO: `/v3/roles` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:05:31.916324 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70f28724-ad8b-4a76-8811-5ed4aef5c3d8 None admin] RBAC: Adding query filter params (name=member) {{(pid=88551) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 19:05:31.916621 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70f28724-ad8b-4a76-8811-5ed4aef5c3d8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:05:31.918080 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70f28724-ad8b-4a76-8811-5ed4aef5c3d8 None admin] RBAC: Authorization granted {{(pid=88551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:05:31.928585 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: [pid: 88551|app: 0|req: 76/154] 10.222.0.26 () {56 vars in 1101 bytes} [Wed Aug 17 19:05:31 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 19:05:31.940288 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af91ce94-f2a0-4656-8a81-9bcf08a7bcd0 None admin] Authenticating user token {{(pid=88550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:05:31.977987 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG dbcounter [-] [88550] Writing DB stats keystone:SELECT=100 {{(pid=88550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:05:32.055429 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70f28724-ad8b-4a76-8811-5ed4aef5c3d8 None admin] Authenticating user token {{(pid=88551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:05:32.119218 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af91ce94-f2a0-4656-8a81-9bcf08a7bcd0 None admin] Validating token access rules against request {{(pid=88550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:05:32.205428 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f59447e-c8d2-474f-8509-07f006b2a861 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '819d41a279e64291acc60de51e1530ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:05:32.205990 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f59447e-c8d2-474f-8509-07f006b2a861 None admin] REQUEST_METHOD: `GET` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:05:32.206283 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f59447e-c8d2-474f-8509-07f006b2a861 None admin] SCRIPT_NAME: `/identity` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:05:32.206526 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f59447e-c8d2-474f-8509-07f006b2a861 None admin] PATH_INFO: `/v3/users/42ca546140f547848db6ed420a5044f3` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:05:32.208661 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f59447e-c8d2-474f-8509-07f006b2a861 None admin] RBAC: Authorizing `identity:get_user(user_id=42ca546140f547848db6ed420a5044f3)` {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:05:32.210162 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f59447e-c8d2-474f-8509-07f006b2a861 None admin] RBAC: Authorization granted {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:05:32.216602 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: [pid: 88550|app: 0|req: 79/155] 10.222.0.26 () {56 vars in 1177 bytes} [Wed Aug 17 19:05:31 2022] GET /identity/v3/users/42ca546140f547848db6ed420a5044f3 => generated 275 bytes in 277 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 19:05:32.223434 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f59447e-c8d2-474f-8509-07f006b2a861 None admin] Authenticating user token {{(pid=88550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:05:32.230935 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG dbcounter [-] [88551] Writing DB stats keystone:SELECT=100 {{(pid=88551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:05:32.287700 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70f28724-ad8b-4a76-8811-5ed4aef5c3d8 None admin] Validating token access rules against request {{(pid=88551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:05:32.376033 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7397018-f82d-40da-bb42-9f25c0aaaa66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '819d41a279e64291acc60de51e1530ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:05:32.376920 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7397018-f82d-40da-bb42-9f25c0aaaa66 None admin] REQUEST_METHOD: `GET` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:05:32.377035 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7397018-f82d-40da-bb42-9f25c0aaaa66 None admin] SCRIPT_NAME: `/identity` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:05:32.377259 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7397018-f82d-40da-bb42-9f25c0aaaa66 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:05:32.407436 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7397018-f82d-40da-bb42-9f25c0aaaa66 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 17 19:05:32.412826 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application [None req-f7397018-f82d-40da-bb42-9f25c0aaaa66 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 17 19:05:32.412826 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 19:05:32.412826 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 19:05:32.412826 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 19:05:32.412826 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 19:05:32.412826 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 19:05:32.412826 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 19:05:32.412826 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 19:05:32.412826 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 19:05:32.412826 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 19:05:32.412826 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 19:05:32.412826 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 19:05:32.412826 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 17 19:05:32.412826 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 17 19:05:32.412826 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 17 19:05:32.412826 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 17 19:05:32.413854 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 17 19:05:32.413854 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 17 19:05:32.413854 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 17 19:05:32.413854 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 17 19:05:32.413854 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 19:05:32.413854 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 19:05:32.413854 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 19:05:32.413854 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 19:05:32.413854 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 19:05:32.413854 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 19:05:32.413854 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 19:05:32.413854 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application with Lock( Aug 17 19:05:32.413854 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 19:05:32.413854 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application return self._enter() Aug 17 19:05:32.413854 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 19:05:32.413854 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 19:05:32.415265 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 19:05:32.415265 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application return self.creator() Aug 17 19:05:32.415265 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 19:05:32.415265 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application created_value = creator( Aug 17 19:05:32.415265 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 17 19:05:32.415265 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 17 19:05:32.415265 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 17 19:05:32.415265 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 17 19:05:32.415265 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 17 19:05:32.415265 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 17 19:05:32.415265 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 17 19:05:32.415265 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application Aug 17 19:05:32.415265 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: [pid: 88551|app: 0|req: 77/156] 10.222.0.26 () {56 vars in 1096 bytes} [Wed Aug 17 19:05:32 2022] GET /identity/v3/roles/admin => generated 83 bytes in 359 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 19:05:32.417711 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b1e0785-c152-4d0e-90ad-a2df471c3810 None None] REQUEST_METHOD: `GET` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:05:32.417995 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b1e0785-c152-4d0e-90ad-a2df471c3810 None None] SCRIPT_NAME: `/identity` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:05:32.418276 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b1e0785-c152-4d0e-90ad-a2df471c3810 None None] PATH_INFO: `/` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:05:32.419651 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: [pid: 88551|app: 0|req: 78/157] 10.222.0.26 () {54 vars in 927 bytes} [Wed Aug 17 19:05:32 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 19:05:32.424077 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b1e0785-c152-4d0e-90ad-a2df471c3810 None None] Authenticating user token {{(pid=88551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:05:32.446581 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG dbcounter [-] [88550] Writing DB stats keystone:SELECT=100 {{(pid=88550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:05:32.475636 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f59447e-c8d2-474f-8509-07f006b2a861 None admin] Validating token access rules against request {{(pid=88550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:05:32.549022 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d305455a-4826-4d90-8699-66a96af93634 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '819d41a279e64291acc60de51e1530ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:05:32.549665 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d305455a-4826-4d90-8699-66a96af93634 None admin] REQUEST_METHOD: `GET` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:05:32.549929 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d305455a-4826-4d90-8699-66a96af93634 None admin] SCRIPT_NAME: `/identity` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:05:32.550202 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d305455a-4826-4d90-8699-66a96af93634 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:05:32.675013 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b1e0785-c152-4d0e-90ad-a2df471c3810 None None] Validating token access rules against request {{(pid=88551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:05:32.695428 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d305455a-4826-4d90-8699-66a96af93634 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:05:32.697685 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d305455a-4826-4d90-8699-66a96af93634 None admin] RBAC: Authorization granted {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:05:32.755026 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d112b14-b068-4ad3-b9b9-732ebdd10620 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '819d41a279e64291acc60de51e1530ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:05:32.755954 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d112b14-b068-4ad3-b9b9-732ebdd10620 None admin] REQUEST_METHOD: `GET` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:05:32.756384 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d112b14-b068-4ad3-b9b9-732ebdd10620 None admin] SCRIPT_NAME: `/identity` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:05:32.756864 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d112b14-b068-4ad3-b9b9-732ebdd10620 None admin] PATH_INFO: `/v3/roles` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:05:32.757709 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d112b14-b068-4ad3-b9b9-732ebdd10620 None admin] RBAC: Adding query filter params (name=admin) {{(pid=88551) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 19:05:32.758158 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d112b14-b068-4ad3-b9b9-732ebdd10620 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:05:32.759715 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d112b14-b068-4ad3-b9b9-732ebdd10620 None admin] RBAC: Authorization granted {{(pid=88551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:05:32.766209 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG dbcounter [-] [88551] Writing DB stats keystone:SELECT=100 {{(pid=88551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:05:32.778292 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: [pid: 88551|app: 0|req: 79/158] 10.222.0.26 () {56 vars in 1099 bytes} [Wed Aug 17 19:05:32 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 355 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 17 19:05:32.779933 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e35a7618-f866-4e65-b501-0ff4353a162d None None] REQUEST_METHOD: `POST` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:05:32.780514 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e35a7618-f866-4e65-b501-0ff4353a162d None None] SCRIPT_NAME: `/identity` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:05:32.781487 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e35a7618-f866-4e65-b501-0ff4353a162d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:05:32.819569 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.auth.core [None req-e35a7618-f866-4e65-b501-0ff4353a162d None None] MFA Rules not processed for user `819d41a279e64291acc60de51e1530ae`. Rule list: `[]` (Enabled: `True`). {{(pid=88551) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 19:05:32.821202 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.common.fernet_utils [None req-e35a7618-f866-4e65-b501-0ff4353a162d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:05:32.864502 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG dbcounter [-] [88550] Writing DB stats keystone:SELECT=100 {{(pid=88550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:05:32.881321 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: [pid: 88550|app: 0|req: 80/159] 10.222.0.26 () {58 vars in 1282 bytes} [Wed Aug 17 19:05:32 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 658 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 17 19:05:32.882239 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d305455a-4826-4d90-8699-66a96af93634 None admin] Authenticating user token {{(pid=88550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:05:32.992489 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: [pid: 88551|app: 0|req: 80/160] 10.222.0.26 () {58 vars in 1024 bytes} [Wed Aug 17 19:05:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 213 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 17 19:05:32.993736 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e35a7618-f866-4e65-b501-0ff4353a162d None None] Authenticating user token {{(pid=88551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:05:33.093545 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d305455a-4826-4d90-8699-66a96af93634 None admin] Validating token access rules against request {{(pid=88550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:05:33.140834 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e35a7618-f866-4e65-b501-0ff4353a162d None None] Validating token access rules against request {{(pid=88551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:05:33.172446 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c62d645-9bbf-41ba-8453-c6ae58c95e69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '819d41a279e64291acc60de51e1530ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:05:33.173151 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c62d645-9bbf-41ba-8453-c6ae58c95e69 None admin] REQUEST_METHOD: `GET` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:05:33.173428 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c62d645-9bbf-41ba-8453-c6ae58c95e69 None admin] SCRIPT_NAME: `/identity` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:05:33.173745 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c62d645-9bbf-41ba-8453-c6ae58c95e69 None admin] PATH_INFO: `/v3/users/819d41a279e64291acc60de51e1530ae` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:05:33.176545 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c62d645-9bbf-41ba-8453-c6ae58c95e69 None admin] RBAC: Authorizing `identity:get_user(user_id=819d41a279e64291acc60de51e1530ae)` {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:05:33.178121 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c62d645-9bbf-41ba-8453-c6ae58c95e69 None admin] RBAC: Authorization granted {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:05:33.180376 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG dbcounter [-] [88551] Writing DB stats keystone:SELECT=100 {{(pid=88551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:05:33.185955 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: [pid: 88550|app: 0|req: 81/161] 10.222.0.26 () {56 vars in 1177 bytes} [Wed Aug 17 19:05:32 2022] GET /identity/v3/users/819d41a279e64291acc60de51e1530ae => generated 247 bytes in 299 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 19:05:33.187778 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c62d645-9bbf-41ba-8453-c6ae58c95e69 None admin] Authenticating user token {{(pid=88550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:05:33.194860 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d92c578-da75-4cdd-91b7-58ee0f8d94f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '819d41a279e64291acc60de51e1530ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:05:33.196589 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d92c578-da75-4cdd-91b7-58ee0f8d94f1 None admin] REQUEST_METHOD: `GET` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:05:33.196589 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d92c578-da75-4cdd-91b7-58ee0f8d94f1 None admin] SCRIPT_NAME: `/identity` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:05:33.196589 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d92c578-da75-4cdd-91b7-58ee0f8d94f1 None admin] PATH_INFO: `/v3/projects/143eeb5624b2449582a0739926bcb8e1` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:05:33.203342 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d92c578-da75-4cdd-91b7-58ee0f8d94f1 None admin] RBAC: Authorizing `identity:get_project(project_id=143eeb5624b2449582a0739926bcb8e1)` {{(pid=88551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:05:33.205191 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d92c578-da75-4cdd-91b7-58ee0f8d94f1 None admin] RBAC: Authorization granted {{(pid=88551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:05:33.207211 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: [pid: 88551|app: 0|req: 81/162] 10.222.0.26 () {56 vars in 1186 bytes} [Wed Aug 17 19:05:32 2022] GET /identity/v3/projects/143eeb5624b2449582a0739926bcb8e1 => generated 298 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 19:05:33.218661 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-365de72b-1880-4081-81e7-2daaf1bea516 None None] REQUEST_METHOD: `GET` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:05:33.219253 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-365de72b-1880-4081-81e7-2daaf1bea516 None None] SCRIPT_NAME: `/identity` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:05:33.219743 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-365de72b-1880-4081-81e7-2daaf1bea516 None None] PATH_INFO: `/` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:05:33.221287 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: [pid: 88551|app: 0|req: 82/163] 10.222.0.26 () {54 vars in 927 bytes} [Wed Aug 17 19:05:33 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 17 19:05:33.222183 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-365de72b-1880-4081-81e7-2daaf1bea516 None None] Authenticating user token {{(pid=88551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:05:33.317902 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG dbcounter [-] [88550] Writing DB stats keystone:SELECT=100 {{(pid=88550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:05:33.413928 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c62d645-9bbf-41ba-8453-c6ae58c95e69 None admin] Validating token access rules against request {{(pid=88550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:05:33.488290 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-365de72b-1880-4081-81e7-2daaf1bea516 None None] Validating token access rules against request {{(pid=88551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:05:33.503187 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-394be2c5-3bad-44aa-ad36-c9829afe6fa3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '819d41a279e64291acc60de51e1530ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:05:33.503828 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-394be2c5-3bad-44aa-ad36-c9829afe6fa3 None admin] REQUEST_METHOD: `GET` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:05:33.504105 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-394be2c5-3bad-44aa-ad36-c9829afe6fa3 None admin] SCRIPT_NAME: `/identity` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:05:33.504377 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-394be2c5-3bad-44aa-ad36-c9829afe6fa3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:05:33.591342 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24f4216c-fdf3-4ac5-a175-1d9e6be8890b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '819d41a279e64291acc60de51e1530ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:05:33.591975 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f4216c-fdf3-4ac5-a175-1d9e6be8890b None admin] REQUEST_METHOD: `GET` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:05:33.592258 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f4216c-fdf3-4ac5-a175-1d9e6be8890b None admin] SCRIPT_NAME: `/identity` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:05:33.592536 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f4216c-fdf3-4ac5-a175-1d9e6be8890b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:05:33.593935 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24f4216c-fdf3-4ac5-a175-1d9e6be8890b None admin] RBAC: Adding query filter params (role.id=748773430faa4030989e1e77b3f361e1, scope.project.id=143eeb5624b2449582a0739926bcb8e1, user.id=42ca546140f547848db6ed420a5044f3) {{(pid=88551) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 19:05:33.594245 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24f4216c-fdf3-4ac5-a175-1d9e6be8890b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:05:33.595815 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24f4216c-fdf3-4ac5-a175-1d9e6be8890b None admin] RBAC: Authorization granted {{(pid=88551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:05:33.605106 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: [pid: 88551|app: 0|req: 83/164] 10.222.0.26 () {56 vars in 1374 bytes} [Wed Aug 17 19:05:33 2022] GET /identity/v3/role_assignments?user.id=42ca546140f547848db6ed420a5044f3&scope.project.id=143eeb5624b2449582a0739926bcb8e1&role.id=748773430faa4030989e1e77b3f361e1 => generated 608 bytes in 383 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 19:05:33.606092 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f57b299a-6507-4fc5-a397-38ee80692ad7 None None] REQUEST_METHOD: `POST` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:05:33.606374 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f57b299a-6507-4fc5-a397-38ee80692ad7 None None] SCRIPT_NAME: `/identity` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:05:33.606686 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f57b299a-6507-4fc5-a397-38ee80692ad7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:05:33.652065 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.auth.core [None req-f57b299a-6507-4fc5-a397-38ee80692ad7 None None] MFA Rules not processed for user `819d41a279e64291acc60de51e1530ae`. Rule list: `[]` (Enabled: `True`). {{(pid=88551) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 19:05:33.653323 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.common.fernet_utils [None req-f57b299a-6507-4fc5-a397-38ee80692ad7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:05:33.704119 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-394be2c5-3bad-44aa-ad36-c9829afe6fa3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:05:33.705543 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-394be2c5-3bad-44aa-ad36-c9829afe6fa3 None admin] RBAC: Authorization granted {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:05:33.762463 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG dbcounter [-] [88551] Writing DB stats keystone:SELECT=100 {{(pid=88551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:05:33.789720 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: [pid: 88551|app: 0|req: 84/165] 10.222.0.26 () {58 vars in 1024 bytes} [Wed Aug 17 19:05:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 17 19:05:33.790111 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG dbcounter [-] [88550] Writing DB stats keystone:SELECT=100 {{(pid=88550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:05:33.791545 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f57b299a-6507-4fc5-a397-38ee80692ad7 None None] Authenticating user token {{(pid=88551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:05:33.851668 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: [pid: 88550|app: 0|req: 82/166] 10.222.0.26 () {58 vars in 1282 bytes} [Wed Aug 17 19:05:33 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 664 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 17 19:05:33.860701 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-394be2c5-3bad-44aa-ad36-c9829afe6fa3 None admin] Authenticating user token {{(pid=88550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:05:34.055350 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f57b299a-6507-4fc5-a397-38ee80692ad7 None None] Validating token access rules against request {{(pid=88551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:05:34.070695 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-394be2c5-3bad-44aa-ad36-c9829afe6fa3 None admin] Validating token access rules against request {{(pid=88550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:05:34.136293 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a28cceaf-a88f-4432-8e60-a74dfddd056c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '819d41a279e64291acc60de51e1530ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:05:34.137368 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a28cceaf-a88f-4432-8e60-a74dfddd056c None admin] REQUEST_METHOD: `GET` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:05:34.137872 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a28cceaf-a88f-4432-8e60-a74dfddd056c None admin] SCRIPT_NAME: `/identity` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:05:34.138245 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9de19a06-502b-4cfc-9768-5b123a90d30c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '819d41a279e64291acc60de51e1530ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:05:34.138392 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a28cceaf-a88f-4432-8e60-a74dfddd056c None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:05:34.139406 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de19a06-502b-4cfc-9768-5b123a90d30c None admin] REQUEST_METHOD: `GET` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:05:34.140431 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de19a06-502b-4cfc-9768-5b123a90d30c None admin] SCRIPT_NAME: `/identity` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:05:34.140918 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de19a06-502b-4cfc-9768-5b123a90d30c None admin] PATH_INFO: `/v3/projects/143eeb5624b2449582a0739926bcb8e1` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:05:34.146385 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9de19a06-502b-4cfc-9768-5b123a90d30c None admin] RBAC: Authorizing `identity:get_project(project_id=143eeb5624b2449582a0739926bcb8e1)` {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:05:34.148109 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9de19a06-502b-4cfc-9768-5b123a90d30c None admin] RBAC: Authorization granted {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:05:34.149988 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: [pid: 88550|app: 0|req: 83/167] 10.222.0.26 () {56 vars in 1186 bytes} [Wed Aug 17 19:05:33 2022] GET /identity/v3/projects/143eeb5624b2449582a0739926bcb8e1 => generated 298 bytes in 290 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 17 19:05:34.156832 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9de19a06-502b-4cfc-9768-5b123a90d30c None admin] Authenticating user token {{(pid=88550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:05:34.168050 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a28cceaf-a88f-4432-8e60-a74dfddd056c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 17 19:05:34.173951 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application [None req-a28cceaf-a88f-4432-8e60-a74dfddd056c None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 17 19:05:34.173951 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 19:05:34.173951 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 19:05:34.173951 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 19:05:34.173951 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 19:05:34.173951 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 19:05:34.173951 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 19:05:34.173951 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 19:05:34.173951 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 19:05:34.173951 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 19:05:34.173951 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 19:05:34.173951 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 19:05:34.173951 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 17 19:05:34.173951 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 17 19:05:34.173951 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 17 19:05:34.173951 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 17 19:05:34.175078 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 17 19:05:34.175078 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 17 19:05:34.175078 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 17 19:05:34.175078 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 17 19:05:34.175078 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 19:05:34.175078 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 19:05:34.175078 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 19:05:34.175078 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 19:05:34.175078 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 19:05:34.175078 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 19:05:34.175078 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 19:05:34.175078 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application with Lock( Aug 17 19:05:34.175078 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 19:05:34.175078 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application return self._enter() Aug 17 19:05:34.175078 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 19:05:34.175078 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 19:05:34.176123 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 19:05:34.176123 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application return self.creator() Aug 17 19:05:34.176123 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 19:05:34.176123 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application created_value = creator( Aug 17 19:05:34.176123 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 17 19:05:34.176123 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 17 19:05:34.176123 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 17 19:05:34.176123 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 17 19:05:34.176123 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 17 19:05:34.176123 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 17 19:05:34.176123 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 17 19:05:34.176123 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application Aug 17 19:05:34.176123 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: [pid: 88551|app: 0|req: 85/168] 10.222.0.26 () {56 vars in 1114 bytes} [Wed Aug 17 19:05:33 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 385 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 19:05:34.183739 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a28cceaf-a88f-4432-8e60-a74dfddd056c None admin] Authenticating user token {{(pid=88551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:05:34.206895 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG dbcounter [-] [88550] Writing DB stats keystone:SELECT=100 {{(pid=88550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:05:34.303885 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG dbcounter [-] [88551] Writing DB stats keystone:SELECT=100 {{(pid=88551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:05:34.332203 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9de19a06-502b-4cfc-9768-5b123a90d30c None admin] Validating token access rules against request {{(pid=88550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:05:34.392160 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a28cceaf-a88f-4432-8e60-a74dfddd056c None admin] Validating token access rules against request {{(pid=88551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:05:34.394027 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91d390eb-1477-4d0f-a84e-1279299457c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '819d41a279e64291acc60de51e1530ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:05:34.394902 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d390eb-1477-4d0f-a84e-1279299457c6 None admin] REQUEST_METHOD: `GET` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:05:34.395383 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d390eb-1477-4d0f-a84e-1279299457c6 None admin] SCRIPT_NAME: `/identity` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:05:34.395871 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d390eb-1477-4d0f-a84e-1279299457c6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:05:34.396820 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91d390eb-1477-4d0f-a84e-1279299457c6 None admin] RBAC: Adding query filter params (role.id=204f62ae18174b60a2e3f5d4f28ea326, scope.project.id=143eeb5624b2449582a0739926bcb8e1, user.id=819d41a279e64291acc60de51e1530ae) {{(pid=88550) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 19:05:34.397341 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91d390eb-1477-4d0f-a84e-1279299457c6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:05:34.403856 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91d390eb-1477-4d0f-a84e-1279299457c6 None admin] RBAC: Authorization granted {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:05:34.410704 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: [pid: 88550|app: 0|req: 84/169] 10.222.0.26 () {56 vars in 1374 bytes} [Wed Aug 17 19:05:34 2022] GET /identity/v3/role_assignments?user.id=819d41a279e64291acc60de51e1530ae&scope.project.id=143eeb5624b2449582a0739926bcb8e1&role.id=204f62ae18174b60a2e3f5d4f28ea326 => generated 608 bytes in 255 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 17 19:05:34.458915 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f56ebce8-6909-434d-a888-91850ac81d93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '819d41a279e64291acc60de51e1530ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:05:34.459551 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f56ebce8-6909-434d-a888-91850ac81d93 None admin] REQUEST_METHOD: `GET` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:05:34.459830 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f56ebce8-6909-434d-a888-91850ac81d93 None admin] SCRIPT_NAME: `/identity` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:05:34.460104 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f56ebce8-6909-434d-a888-91850ac81d93 None admin] PATH_INFO: `/v3/roles` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:05:34.460844 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f56ebce8-6909-434d-a888-91850ac81d93 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=88551) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 19:05:34.461148 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f56ebce8-6909-434d-a888-91850ac81d93 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:05:34.462692 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f56ebce8-6909-434d-a888-91850ac81d93 None admin] RBAC: Authorization granted {{(pid=88551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:05:34.478937 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91d390eb-1477-4d0f-a84e-1279299457c6 None admin] Authenticating user token {{(pid=88550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:05:34.480245 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: [pid: 88551|app: 0|req: 86/170] 10.222.0.26 () {56 vars in 1111 bytes} [Wed Aug 17 19:05:34 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 297 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 17 19:05:34.487991 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f56ebce8-6909-434d-a888-91850ac81d93 None admin] Authenticating user token {{(pid=88551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:05:34.653689 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG dbcounter [-] [88550] Writing DB stats keystone:SELECT=100 {{(pid=88550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:05:34.655670 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f56ebce8-6909-434d-a888-91850ac81d93 None admin] Validating token access rules against request {{(pid=88551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:05:34.671625 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91d390eb-1477-4d0f-a84e-1279299457c6 None admin] Validating token access rules against request {{(pid=88550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:05:34.678789 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG dbcounter [-] [88551] Writing DB stats keystone:SELECT=100 {{(pid=88551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:05:34.709405 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fb9d26f-13b2-465a-a13b-76bdf54d3285 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '819d41a279e64291acc60de51e1530ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:05:34.710351 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb9d26f-13b2-465a-a13b-76bdf54d3285 None admin] REQUEST_METHOD: `GET` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:05:34.711986 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb9d26f-13b2-465a-a13b-76bdf54d3285 None admin] SCRIPT_NAME: `/identity` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:05:34.712500 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb9d26f-13b2-465a-a13b-76bdf54d3285 None admin] PATH_INFO: `/v3/users/42ca546140f547848db6ed420a5044f3` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:05:34.721660 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fb9d26f-13b2-465a-a13b-76bdf54d3285 None admin] RBAC: Authorizing `identity:get_user(user_id=42ca546140f547848db6ed420a5044f3)` {{(pid=88551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:05:34.723810 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fb9d26f-13b2-465a-a13b-76bdf54d3285 None admin] RBAC: Authorization granted {{(pid=88551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:05:34.727640 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: [pid: 88551|app: 0|req: 87/171] 10.222.0.26 () {56 vars in 1177 bytes} [Wed Aug 17 19:05:34 2022] GET /identity/v3/users/42ca546140f547848db6ed420a5044f3 => generated 275 bytes in 242 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 17 19:05:34.734154 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fb9d26f-13b2-465a-a13b-76bdf54d3285 None admin] Authenticating user token {{(pid=88551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:05:34.756374 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7ba90c0-6f48-4c61-99a5-29a894980e01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '819d41a279e64291acc60de51e1530ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:05:34.757644 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ba90c0-6f48-4c61-99a5-29a894980e01 None admin] REQUEST_METHOD: `GET` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:05:34.758156 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ba90c0-6f48-4c61-99a5-29a894980e01 None admin] SCRIPT_NAME: `/identity` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:05:34.758604 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ba90c0-6f48-4c61-99a5-29a894980e01 None admin] PATH_INFO: `/v3/roles/member` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:05:34.785955 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7ba90c0-6f48-4c61-99a5-29a894980e01 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 17 19:05:34.798860 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application [None req-a7ba90c0-6f48-4c61-99a5-29a894980e01 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 17 19:05:34.798860 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 19:05:34.798860 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 19:05:34.798860 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 19:05:34.798860 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 19:05:34.798860 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 19:05:34.798860 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 19:05:34.798860 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 19:05:34.798860 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 19:05:34.798860 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 19:05:34.798860 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 19:05:34.798860 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 19:05:34.798860 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 17 19:05:34.798860 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 17 19:05:34.798860 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 17 19:05:34.798860 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 17 19:05:34.800041 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 17 19:05:34.800041 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 17 19:05:34.800041 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 17 19:05:34.800041 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 17 19:05:34.800041 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 19:05:34.800041 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 19:05:34.800041 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 19:05:34.800041 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 19:05:34.800041 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 19:05:34.800041 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 19:05:34.800041 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 19:05:34.800041 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application with Lock( Aug 17 19:05:34.800041 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 19:05:34.800041 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return self._enter() Aug 17 19:05:34.800041 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 19:05:34.800041 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 19:05:34.801175 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 19:05:34.801175 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return self.creator() Aug 17 19:05:34.801175 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 19:05:34.801175 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application created_value = creator( Aug 17 19:05:34.801175 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 17 19:05:34.801175 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 17 19:05:34.801175 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 17 19:05:34.801175 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 17 19:05:34.801175 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 17 19:05:34.801175 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 17 19:05:34.801175 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 17 19:05:34.801175 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application Aug 17 19:05:34.803688 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: [pid: 88550|app: 0|req: 85/172] 10.222.0.26 () {56 vars in 1099 bytes} [Wed Aug 17 19:05:34 2022] GET /identity/v3/roles/member => generated 84 bytes in 325 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 19:05:34.811675 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7ba90c0-6f48-4c61-99a5-29a894980e01 None admin] Authenticating user token {{(pid=88550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:05:34.948628 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7ba90c0-6f48-4c61-99a5-29a894980e01 None admin] Validating token access rules against request {{(pid=88550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:05:34.993231 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fb9d26f-13b2-465a-a13b-76bdf54d3285 None admin] Validating token access rules against request {{(pid=88551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:05:35.004170 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-778f9192-ca6a-477e-bc14-6ddcd50c7b97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '819d41a279e64291acc60de51e1530ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:05:35.005066 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-778f9192-ca6a-477e-bc14-6ddcd50c7b97 None admin] REQUEST_METHOD: `GET` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:05:35.005498 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-778f9192-ca6a-477e-bc14-6ddcd50c7b97 None admin] SCRIPT_NAME: `/identity` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:05:35.005983 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-778f9192-ca6a-477e-bc14-6ddcd50c7b97 None admin] PATH_INFO: `/v3/roles` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:05:35.006923 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-778f9192-ca6a-477e-bc14-6ddcd50c7b97 None admin] RBAC: Adding query filter params (name=member) {{(pid=88550) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 19:05:35.007379 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-778f9192-ca6a-477e-bc14-6ddcd50c7b97 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:05:35.008938 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-778f9192-ca6a-477e-bc14-6ddcd50c7b97 None admin] RBAC: Authorization granted {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:05:35.019737 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: [pid: 88550|app: 0|req: 86/173] 10.222.0.26 () {56 vars in 1101 bytes} [Wed Aug 17 19:05:34 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 19:05:35.025957 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-778f9192-ca6a-477e-bc14-6ddcd50c7b97 None admin] Authenticating user token {{(pid=88550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:05:35.045329 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG dbcounter [-] [88550] Writing DB stats keystone:SELECT=100 {{(pid=88550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:05:35.054307 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-834127b8-e1f4-46be-9606-c5edfedcc0e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '819d41a279e64291acc60de51e1530ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:05:35.054877 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-834127b8-e1f4-46be-9606-c5edfedcc0e0 None admin] REQUEST_METHOD: `GET` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:05:35.055272 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-834127b8-e1f4-46be-9606-c5edfedcc0e0 None admin] SCRIPT_NAME: `/identity` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:05:35.055638 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-834127b8-e1f4-46be-9606-c5edfedcc0e0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:05:35.147734 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-778f9192-ca6a-477e-bc14-6ddcd50c7b97 None admin] Validating token access rules against request {{(pid=88550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:05:35.166785 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG dbcounter [-] [88551] Writing DB stats keystone:SELECT=100 {{(pid=88551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:05:35.194069 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc0fd2f6-c725-47b8-aadc-171860ec0b89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '819d41a279e64291acc60de51e1530ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:05:35.195108 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc0fd2f6-c725-47b8-aadc-171860ec0b89 None admin] REQUEST_METHOD: `GET` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:05:35.197161 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc0fd2f6-c725-47b8-aadc-171860ec0b89 None admin] SCRIPT_NAME: `/identity` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:05:35.197684 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc0fd2f6-c725-47b8-aadc-171860ec0b89 None admin] PATH_INFO: `/v3/users/42ca546140f547848db6ed420a5044f3` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:05:35.200163 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc0fd2f6-c725-47b8-aadc-171860ec0b89 None admin] RBAC: Authorizing `identity:get_user(user_id=42ca546140f547848db6ed420a5044f3)` {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:05:35.203263 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc0fd2f6-c725-47b8-aadc-171860ec0b89 None admin] RBAC: Authorization granted {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:05:35.205523 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: [pid: 88550|app: 0|req: 87/174] 10.222.0.26 () {56 vars in 1177 bytes} [Wed Aug 17 19:05:35 2022] GET /identity/v3/users/42ca546140f547848db6ed420a5044f3 => generated 275 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 17 19:05:35.211112 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc0fd2f6-c725-47b8-aadc-171860ec0b89 None admin] Authenticating user token {{(pid=88550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:05:35.214155 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-834127b8-e1f4-46be-9606-c5edfedcc0e0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:05:35.217612 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-834127b8-e1f4-46be-9606-c5edfedcc0e0 None admin] RBAC: Authorization granted {{(pid=88551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:05:35.338505 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG dbcounter [-] [88550] Writing DB stats keystone:SELECT=100 {{(pid=88550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:05:35.360558 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc0fd2f6-c725-47b8-aadc-171860ec0b89 None admin] Validating token access rules against request {{(pid=88550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:05:35.399594 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e199b3b2-8e45-49e3-a6ee-c51a2df6cdd1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '819d41a279e64291acc60de51e1530ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:05:35.400497 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e199b3b2-8e45-49e3-a6ee-c51a2df6cdd1 None admin] REQUEST_METHOD: `GET` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:05:35.400931 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e199b3b2-8e45-49e3-a6ee-c51a2df6cdd1 None admin] SCRIPT_NAME: `/identity` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:05:35.401450 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e199b3b2-8e45-49e3-a6ee-c51a2df6cdd1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:05:35.422488 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: [pid: 88551|app: 0|req: 88/175] 10.222.0.26 () {58 vars in 1282 bytes} [Wed Aug 17 19:05:34 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 689 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 17 19:05:35.428285 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-834127b8-e1f4-46be-9606-c5edfedcc0e0 None admin] Authenticating user token {{(pid=88551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:05:35.491292 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e199b3b2-8e45-49e3-a6ee-c51a2df6cdd1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:05:35.496179 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e199b3b2-8e45-49e3-a6ee-c51a2df6cdd1 None admin] RBAC: Authorization granted {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:05:35.593774 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG dbcounter [-] [88551] Writing DB stats keystone:SELECT=100 {{(pid=88551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:05:35.634347 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-834127b8-e1f4-46be-9606-c5edfedcc0e0 None admin] Validating token access rules against request {{(pid=88551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:05:35.664085 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG dbcounter [-] [88550] Writing DB stats keystone:SELECT=100 {{(pid=88550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:05:35.681415 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1107eae9-a25e-4620-93e8-8dd2f62b0576 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '819d41a279e64291acc60de51e1530ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:05:35.682131 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1107eae9-a25e-4620-93e8-8dd2f62b0576 None admin] REQUEST_METHOD: `GET` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:05:35.682317 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1107eae9-a25e-4620-93e8-8dd2f62b0576 None admin] SCRIPT_NAME: `/identity` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:05:35.682608 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1107eae9-a25e-4620-93e8-8dd2f62b0576 None admin] PATH_INFO: `/v3/projects/143eeb5624b2449582a0739926bcb8e1` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:05:35.684180 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1107eae9-a25e-4620-93e8-8dd2f62b0576 None admin] RBAC: Authorizing `identity:get_project(project_id=143eeb5624b2449582a0739926bcb8e1)` {{(pid=88551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:05:35.685728 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1107eae9-a25e-4620-93e8-8dd2f62b0576 None admin] RBAC: Authorization granted {{(pid=88551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:05:35.688013 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: [pid: 88551|app: 0|req: 89/176] 10.222.0.26 () {56 vars in 1186 bytes} [Wed Aug 17 19:05:35 2022] GET /identity/v3/projects/143eeb5624b2449582a0739926bcb8e1 => generated 298 bytes in 260 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 19:05:35.689732 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-604837d7-658a-428b-9f96-631dd2991914 None None] REQUEST_METHOD: `GET` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:05:35.689732 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-604837d7-658a-428b-9f96-631dd2991914 None None] SCRIPT_NAME: `/identity` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:05:35.689732 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-604837d7-658a-428b-9f96-631dd2991914 None None] PATH_INFO: `/` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:05:35.689989 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: [pid: 88550|app: 0|req: 88/177] 10.222.0.26 () {58 vars in 1282 bytes} [Wed Aug 17 19:05:35 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 479 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 17 19:05:35.691262 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f841260-c4e8-49e9-aa15-cc8d17206782 None None] REQUEST_METHOD: `GET` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:05:35.691550 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f841260-c4e8-49e9-aa15-cc8d17206782 None None] SCRIPT_NAME: `/identity` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:05:35.691829 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f841260-c4e8-49e9-aa15-cc8d17206782 None None] PATH_INFO: `/` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:05:35.693212 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: [pid: 88550|app: 0|req: 89/178] 10.222.0.26 () {54 vars in 927 bytes} [Wed Aug 17 19:05:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 19:05:35.694282 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e69c37-ac08-4949-a036-5aefe1a25889 None None] REQUEST_METHOD: `GET` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:05:35.694590 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e69c37-ac08-4949-a036-5aefe1a25889 None None] SCRIPT_NAME: `/identity` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:05:35.694871 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e69c37-ac08-4949-a036-5aefe1a25889 None None] PATH_INFO: `/` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:05:35.695621 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: [pid: 88551|app: 0|req: 90/179] 10.222.0.26 () {54 vars in 927 bytes} [Wed Aug 17 19:05:35 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 19:05:35.696409 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: [pid: 88550|app: 0|req: 90/180] 10.222.0.26 () {54 vars in 927 bytes} [Wed Aug 17 19:05:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 19:05:35.702205 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06e69c37-ac08-4949-a036-5aefe1a25889 None None] Authenticating user token {{(pid=88550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:05:35.702371 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-604837d7-658a-428b-9f96-631dd2991914 None None] Authenticating user token {{(pid=88551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:05:35.805972 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-604837d7-658a-428b-9f96-631dd2991914 None None] Validating token access rules against request {{(pid=88551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:05:35.813502 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06e69c37-ac08-4949-a036-5aefe1a25889 None None] Validating token access rules against request {{(pid=88550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:05:35.841321 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72d76554-b651-4521-8c28-af5faf4f9593 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '819d41a279e64291acc60de51e1530ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:05:35.841928 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d76554-b651-4521-8c28-af5faf4f9593 None admin] REQUEST_METHOD: `GET` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:05:35.842213 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d76554-b651-4521-8c28-af5faf4f9593 None admin] SCRIPT_NAME: `/identity` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:05:35.842556 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d76554-b651-4521-8c28-af5faf4f9593 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:05:35.843915 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72d76554-b651-4521-8c28-af5faf4f9593 None admin] RBAC: Adding query filter params (role.id=60df6490940943d3b281ddaab1b0b9f7, scope.project.id=143eeb5624b2449582a0739926bcb8e1, user.id=42ca546140f547848db6ed420a5044f3) {{(pid=88551) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 19:05:35.844229 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72d76554-b651-4521-8c28-af5faf4f9593 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:05:35.845733 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72d76554-b651-4521-8c28-af5faf4f9593 None admin] RBAC: Authorization granted {{(pid=88551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:05:35.848227 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58e55e8e-8fd4-429f-af92-566c8bfd72cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '819d41a279e64291acc60de51e1530ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:05:35.848844 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e55e8e-8fd4-429f-af92-566c8bfd72cc None admin] REQUEST_METHOD: `GET` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:05:35.849118 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e55e8e-8fd4-429f-af92-566c8bfd72cc None admin] SCRIPT_NAME: `/identity` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:05:35.849381 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e55e8e-8fd4-429f-af92-566c8bfd72cc None admin] PATH_INFO: `/v3/projects/977262cf031442a1bc34c590144079a1` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:05:35.850470 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58e55e8e-8fd4-429f-af92-566c8bfd72cc None admin] RBAC: Authorizing `identity:get_project(project_id=977262cf031442a1bc34c590144079a1)` {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:05:35.851740 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: [pid: 88551|app: 0|req: 91/181] 10.222.0.26 () {56 vars in 1374 bytes} [Wed Aug 17 19:05:35 2022] GET /identity/v3/role_assignments?user.id=42ca546140f547848db6ed420a5044f3&scope.project.id=143eeb5624b2449582a0739926bcb8e1&role.id=60df6490940943d3b281ddaab1b0b9f7 => generated 608 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 19:05:35.851923 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58e55e8e-8fd4-429f-af92-566c8bfd72cc None admin] RBAC: Authorization granted {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:05:35.852954 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c303cad3-8c3f-49d4-997d-aade68231f3f None None] REQUEST_METHOD: `POST` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:05:35.853241 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c303cad3-8c3f-49d4-997d-aade68231f3f None None] SCRIPT_NAME: `/identity` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:05:35.859140 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c303cad3-8c3f-49d4-997d-aade68231f3f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:05:35.859346 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: [pid: 88550|app: 0|req: 91/182] 10.222.0.26 () {56 vars in 1186 bytes} [Wed Aug 17 19:05:35 2022] GET /identity/v3/projects/977262cf031442a1bc34c590144079a1 => generated 312 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 19:05:35.859346 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-289fe8e2-b09e-41d4-97cb-12526a6fc6b8 None None] REQUEST_METHOD: `POST` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:05:35.859346 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-289fe8e2-b09e-41d4-97cb-12526a6fc6b8 None None] SCRIPT_NAME: `/identity` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:05:35.859346 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-289fe8e2-b09e-41d4-97cb-12526a6fc6b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:05:35.875931 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.auth.core [None req-c303cad3-8c3f-49d4-997d-aade68231f3f None None] MFA Rules not processed for user `819d41a279e64291acc60de51e1530ae`. Rule list: `[]` (Enabled: `True`). {{(pid=88551) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 19:05:35.877233 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.common.fernet_utils [None req-c303cad3-8c3f-49d4-997d-aade68231f3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:05:35.884651 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.auth.core [None req-289fe8e2-b09e-41d4-97cb-12526a6fc6b8 None None] MFA Rules not processed for user `819d41a279e64291acc60de51e1530ae`. Rule list: `[]` (Enabled: `True`). {{(pid=88550) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 19:05:35.887178 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG dbcounter [-] [88551] Writing DB stats keystone:SELECT=100 {{(pid=88551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:05:35.888230 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.common.fernet_utils [None req-289fe8e2-b09e-41d4-97cb-12526a6fc6b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:05:35.947509 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG dbcounter [-] [88550] Writing DB stats keystone:SELECT=100 {{(pid=88550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:05:35.966957 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: [pid: 88551|app: 0|req: 92/183] 10.222.0.26 () {58 vars in 1024 bytes} [Wed Aug 17 19:05:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 17 19:05:35.968515 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5185b5fe-23ec-415b-967d-ec1ce3c4faff None None] REQUEST_METHOD: `POST` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:05:35.968785 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5185b5fe-23ec-415b-967d-ec1ce3c4faff None None] SCRIPT_NAME: `/identity` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:05:35.969054 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5185b5fe-23ec-415b-967d-ec1ce3c4faff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:05:35.988091 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: [pid: 88550|app: 0|req: 92/184] 10.222.0.26 () {58 vars in 1024 bytes} [Wed Aug 17 19:05:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 17 19:05:35.988671 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.auth.core [None req-5185b5fe-23ec-415b-967d-ec1ce3c4faff None None] MFA Rules not processed for user `819d41a279e64291acc60de51e1530ae`. Rule list: `[]` (Enabled: `True`). {{(pid=88551) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 19:05:35.989947 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.common.fernet_utils [None req-5185b5fe-23ec-415b-967d-ec1ce3c4faff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:05:35.990463 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea72c81-3f10-4dfe-b787-825b48836d88 None None] REQUEST_METHOD: `GET` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:05:35.991024 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea72c81-3f10-4dfe-b787-825b48836d88 None None] SCRIPT_NAME: `/identity` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:05:35.991565 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea72c81-3f10-4dfe-b787-825b48836d88 None None] PATH_INFO: `/` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:05:35.994790 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: [pid: 88550|app: 0|req: 93/185] 10.222.0.26 () {54 vars in 927 bytes} [Wed Aug 17 19:05:35 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 19:05:35.995946 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fea72c81-3f10-4dfe-b787-825b48836d88 None None] Authenticating user token {{(pid=88550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:05:36.094353 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: [pid: 88551|app: 0|req: 93/186] 10.222.0.26 () {58 vars in 1024 bytes} [Wed Aug 17 19:05:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 17 19:05:36.095988 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db2f73b-feef-4d39-80df-fe994c299c71 None None] REQUEST_METHOD: `POST` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:05:36.096413 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db2f73b-feef-4d39-80df-fe994c299c71 None None] SCRIPT_NAME: `/identity` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:05:36.096693 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db2f73b-feef-4d39-80df-fe994c299c71 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:05:36.123505 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.auth.core [None req-3db2f73b-feef-4d39-80df-fe994c299c71 None None] MFA Rules not processed for user `819d41a279e64291acc60de51e1530ae`. Rule list: `[]` (Enabled: `True`). {{(pid=88551) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 19:05:36.125216 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.common.fernet_utils [None req-3db2f73b-feef-4d39-80df-fe994c299c71 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:05:36.167255 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fea72c81-3f10-4dfe-b787-825b48836d88 None None] Validating token access rules against request {{(pid=88550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:05:36.215382 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: [pid: 88551|app: 0|req: 94/187] 10.222.0.26 () {58 vars in 1024 bytes} [Wed Aug 17 19:05:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 17 19:05:36.227575 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2204931-d645-475d-8006-a0f3945063f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '819d41a279e64291acc60de51e1530ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:05:36.228450 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2204931-d645-475d-8006-a0f3945063f7 None admin] REQUEST_METHOD: `GET` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:05:36.229058 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2204931-d645-475d-8006-a0f3945063f7 None admin] SCRIPT_NAME: `/identity` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:05:36.229552 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2204931-d645-475d-8006-a0f3945063f7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:05:36.230464 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2204931-d645-475d-8006-a0f3945063f7 None admin] RBAC: Adding query filter params (role.id=748773430faa4030989e1e77b3f361e1, scope.project.id=977262cf031442a1bc34c590144079a1, user.id=42ca546140f547848db6ed420a5044f3) {{(pid=88550) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 19:05:36.231028 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2204931-d645-475d-8006-a0f3945063f7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:05:36.232707 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2204931-d645-475d-8006-a0f3945063f7 None admin] RBAC: Authorization granted {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:05:36.247569 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: [pid: 88550|app: 0|req: 94/188] 10.222.0.26 () {56 vars in 1374 bytes} [Wed Aug 17 19:05:35 2022] GET /identity/v3/role_assignments?user.id=42ca546140f547848db6ed420a5044f3&scope.project.id=977262cf031442a1bc34c590144079a1&role.id=748773430faa4030989e1e77b3f361e1 => generated 608 bytes in 252 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 19:05:36.375790 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3db2f73b-feef-4d39-80df-fe994c299c71 None None] Authenticating user token {{(pid=88551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:05:36.378820 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG dbcounter [-] [88551] Writing DB stats keystone:SELECT=100 {{(pid=88551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:05:36.426986 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2204931-d645-475d-8006-a0f3945063f7 None admin] Authenticating user token {{(pid=88550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:05:36.514953 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG dbcounter [-] [88550] Writing DB stats keystone:SELECT=100 {{(pid=88550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:05:36.543708 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3db2f73b-feef-4d39-80df-fe994c299c71 None None] Validating token access rules against request {{(pid=88551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:05:36.591487 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2204931-d645-475d-8006-a0f3945063f7 None admin] Validating token access rules against request {{(pid=88550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:05:36.594216 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa3a6338-6aa4-4e18-ab62-d5037ade5caf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '819d41a279e64291acc60de51e1530ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:05:36.595771 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa3a6338-6aa4-4e18-ab62-d5037ade5caf None admin] REQUEST_METHOD: `GET` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:05:36.596053 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa3a6338-6aa4-4e18-ab62-d5037ade5caf None admin] SCRIPT_NAME: `/identity` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:05:36.596324 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa3a6338-6aa4-4e18-ab62-d5037ade5caf None admin] PATH_INFO: `/v3/domains/default` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:05:36.597462 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa3a6338-6aa4-4e18-ab62-d5037ade5caf None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=88551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:05:36.601390 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa3a6338-6aa4-4e18-ab62-d5037ade5caf None admin] RBAC: Authorization granted {{(pid=88551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:05:36.601390 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: [pid: 88551|app: 0|req: 95/189] 10.222.0.26 () {56 vars in 1108 bytes} [Wed Aug 17 19:05:36 2022] GET /identity/v3/domains/default => generated 199 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 19:05:36.602668 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa3a6338-6aa4-4e18-ab62-d5037ade5caf None admin] Authenticating user token {{(pid=88551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:05:36.633829 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62513619-6de4-465c-a08c-52191d3f0d5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '819d41a279e64291acc60de51e1530ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:05:36.634377 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62513619-6de4-465c-a08c-52191d3f0d5b None admin] REQUEST_METHOD: `GET` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:05:36.634683 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62513619-6de4-465c-a08c-52191d3f0d5b None admin] SCRIPT_NAME: `/identity` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:05:36.634957 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62513619-6de4-465c-a08c-52191d3f0d5b None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:05:36.647367 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62513619-6de4-465c-a08c-52191d3f0d5b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 17 19:05:36.652699 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application [None req-62513619-6de4-465c-a08c-52191d3f0d5b None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 17 19:05:36.652699 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 19:05:36.652699 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 19:05:36.652699 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 19:05:36.652699 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 19:05:36.652699 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 19:05:36.652699 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 19:05:36.652699 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 19:05:36.652699 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 19:05:36.652699 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 19:05:36.652699 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 19:05:36.652699 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 19:05:36.652699 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 17 19:05:36.652699 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 17 19:05:36.652699 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 17 19:05:36.652699 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 17 19:05:36.653592 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 17 19:05:36.653592 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 17 19:05:36.653592 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 17 19:05:36.653592 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 17 19:05:36.653592 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 19:05:36.653592 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 19:05:36.653592 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 19:05:36.653592 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 19:05:36.653592 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 19:05:36.653592 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 19:05:36.653592 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 19:05:36.653592 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application with Lock( Aug 17 19:05:36.653592 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 19:05:36.653592 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return self._enter() Aug 17 19:05:36.653592 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 19:05:36.653592 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 19:05:36.654383 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 19:05:36.654383 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return self.creator() Aug 17 19:05:36.654383 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 19:05:36.654383 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application created_value = creator( Aug 17 19:05:36.654383 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 17 19:05:36.654383 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 17 19:05:36.654383 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 17 19:05:36.654383 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 17 19:05:36.654383 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 17 19:05:36.654383 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 17 19:05:36.654383 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 17 19:05:36.654383 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application Aug 17 19:05:36.654383 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: [pid: 88550|app: 0|req: 95/190] 10.222.0.26 () {56 vars in 1096 bytes} [Wed Aug 17 19:05:36 2022] GET /identity/v3/roles/admin => generated 83 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 19:05:36.655189 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62513619-6de4-465c-a08c-52191d3f0d5b None admin] Authenticating user token {{(pid=88550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:05:36.684999 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG dbcounter [-] [88551] Writing DB stats keystone:SELECT=100 {{(pid=88551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:05:36.714898 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa3a6338-6aa4-4e18-ab62-d5037ade5caf None admin] Validating token access rules against request {{(pid=88551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:05:36.750114 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59e76efb-d365-4910-9ba4-ee3318c0005e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '819d41a279e64291acc60de51e1530ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:05:36.750780 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e76efb-d365-4910-9ba4-ee3318c0005e None admin] REQUEST_METHOD: `GET` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:05:36.751111 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e76efb-d365-4910-9ba4-ee3318c0005e None admin] SCRIPT_NAME: `/identity` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:05:36.751387 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e76efb-d365-4910-9ba4-ee3318c0005e None admin] PATH_INFO: `/v3/roles/reader` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:05:36.755026 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62513619-6de4-465c-a08c-52191d3f0d5b None admin] Validating token access rules against request {{(pid=88550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:05:36.756600 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG dbcounter [-] [88550] Writing DB stats keystone:SELECT=100 {{(pid=88550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:05:36.769441 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59e76efb-d365-4910-9ba4-ee3318c0005e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 17 19:05:36.774401 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application [None req-59e76efb-d365-4910-9ba4-ee3318c0005e None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 17 19:05:36.774401 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 19:05:36.774401 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 19:05:36.774401 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 19:05:36.774401 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 19:05:36.774401 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 19:05:36.774401 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 19:05:36.774401 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 19:05:36.774401 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 19:05:36.774401 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 19:05:36.774401 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 19:05:36.774401 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 19:05:36.774401 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 17 19:05:36.774401 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 17 19:05:36.774401 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 17 19:05:36.774401 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 17 19:05:36.775451 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 17 19:05:36.775451 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 17 19:05:36.775451 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 17 19:05:36.775451 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 17 19:05:36.775451 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 19:05:36.775451 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 19:05:36.775451 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 19:05:36.775451 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 19:05:36.775451 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 19:05:36.775451 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 19:05:36.775451 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 19:05:36.775451 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application with Lock( Aug 17 19:05:36.775451 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 19:05:36.775451 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application return self._enter() Aug 17 19:05:36.775451 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 19:05:36.775451 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 19:05:36.776240 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 19:05:36.776240 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application return self.creator() Aug 17 19:05:36.776240 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 19:05:36.776240 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application created_value = creator( Aug 17 19:05:36.776240 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 17 19:05:36.776240 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 17 19:05:36.776240 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 17 19:05:36.776240 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 17 19:05:36.776240 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 17 19:05:36.776240 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 17 19:05:36.776240 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 17 19:05:36.776240 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application Aug 17 19:05:36.776240 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: [pid: 88551|app: 0|req: 96/191] 10.222.0.26 () {56 vars in 1099 bytes} [Wed Aug 17 19:05:36 2022] GET /identity/v3/roles/reader => generated 84 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 19:05:36.776900 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59e76efb-d365-4910-9ba4-ee3318c0005e None admin] Authenticating user token {{(pid=88551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:05:36.790810 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-329c789b-5688-4821-aa5c-d732d2bff394 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '819d41a279e64291acc60de51e1530ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:05:36.791441 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-329c789b-5688-4821-aa5c-d732d2bff394 None admin] REQUEST_METHOD: `POST` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:05:36.791719 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-329c789b-5688-4821-aa5c-d732d2bff394 None admin] SCRIPT_NAME: `/identity` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:05:36.791987 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-329c789b-5688-4821-aa5c-d732d2bff394 None admin] PATH_INFO: `/v3/users` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:05:36.792623 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-329c789b-5688-4821-aa5c-d732d2bff394 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:05:36.794142 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-329c789b-5688-4821-aa5c-d732d2bff394 None admin] RBAC: Authorization granted {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:05:36.877399 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59e76efb-d365-4910-9ba4-ee3318c0005e None admin] Validating token access rules against request {{(pid=88551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:05:36.918491 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG dbcounter [-] [88551] Writing DB stats keystone:SELECT=100 {{(pid=88551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:05:36.918491 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7714e3f-068e-4094-86c0-997722960532 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '819d41a279e64291acc60de51e1530ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:05:36.918491 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7714e3f-068e-4094-86c0-997722960532 None admin] REQUEST_METHOD: `GET` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:05:36.918491 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7714e3f-068e-4094-86c0-997722960532 None admin] SCRIPT_NAME: `/identity` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:05:36.918883 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7714e3f-068e-4094-86c0-997722960532 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:05:36.926897 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7714e3f-068e-4094-86c0-997722960532 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 17 19:05:36.931941 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application [None req-d7714e3f-068e-4094-86c0-997722960532 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 17 19:05:36.931941 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 19:05:36.931941 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 19:05:36.931941 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 19:05:36.931941 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 19:05:36.931941 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 19:05:36.931941 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 19:05:36.931941 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 19:05:36.931941 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 19:05:36.931941 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 19:05:36.931941 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 19:05:36.931941 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 19:05:36.931941 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 17 19:05:36.931941 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 17 19:05:36.931941 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 17 19:05:36.931941 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 17 19:05:36.932960 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 17 19:05:36.932960 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 17 19:05:36.932960 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 17 19:05:36.932960 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 17 19:05:36.932960 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 19:05:36.932960 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 19:05:36.932960 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 19:05:36.932960 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 19:05:36.932960 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 19:05:36.932960 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 19:05:36.932960 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 19:05:36.932960 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application with Lock( Aug 17 19:05:36.932960 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 19:05:36.932960 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application return self._enter() Aug 17 19:05:36.932960 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 19:05:36.932960 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 19:05:36.934254 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 19:05:36.934254 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application return self.creator() Aug 17 19:05:36.934254 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 19:05:36.934254 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application created_value = creator( Aug 17 19:05:36.934254 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 17 19:05:36.934254 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 17 19:05:36.934254 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 17 19:05:36.934254 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 17 19:05:36.934254 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 17 19:05:36.934254 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 17 19:05:36.934254 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 17 19:05:36.934254 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application Aug 17 19:05:36.934254 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: [pid: 88551|app: 0|req: 97/192] 10.222.0.26 () {56 vars in 1114 bytes} [Wed Aug 17 19:05:36 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 19:05:36.934254 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7714e3f-068e-4094-86c0-997722960532 None admin] Authenticating user token {{(pid=88551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:05:36.945113 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: [pid: 88550|app: 0|req: 96/193] 10.222.0.26 () {60 vars in 1132 bytes} [Wed Aug 17 19:05:36 2022] POST /identity/v3/users => generated 297 bytes in 291 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 19:05:36.946781 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-329c789b-5688-4821-aa5c-d732d2bff394 None admin] Authenticating user token {{(pid=88550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:05:37.070284 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7714e3f-068e-4094-86c0-997722960532 None admin] Validating token access rules against request {{(pid=88551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:05:37.070520 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-329c789b-5688-4821-aa5c-d732d2bff394 None admin] Validating token access rules against request {{(pid=88550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:05:37.110898 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d34a1ae-3e14-40bd-9d09-a882c6b39422 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '819d41a279e64291acc60de51e1530ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:05:37.111564 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d34a1ae-3e14-40bd-9d09-a882c6b39422 None admin] REQUEST_METHOD: `GET` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:05:37.111799 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d34a1ae-3e14-40bd-9d09-a882c6b39422 None admin] SCRIPT_NAME: `/identity` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:05:37.112126 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d34a1ae-3e14-40bd-9d09-a882c6b39422 None admin] PATH_INFO: `/v3/roles` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:05:37.112747 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d34a1ae-3e14-40bd-9d09-a882c6b39422 None admin] RBAC: Adding query filter params (name=reader) {{(pid=88550) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 19:05:37.112845 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-959e1a87-ca88-4fb9-af19-77679af2636c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '819d41a279e64291acc60de51e1530ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:05:37.113051 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d34a1ae-3e14-40bd-9d09-a882c6b39422 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:05:37.113443 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-959e1a87-ca88-4fb9-af19-77679af2636c None admin] REQUEST_METHOD: `GET` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:05:37.113745 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-959e1a87-ca88-4fb9-af19-77679af2636c None admin] SCRIPT_NAME: `/identity` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:05:37.114041 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-959e1a87-ca88-4fb9-af19-77679af2636c None admin] PATH_INFO: `/v3/roles` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:05:37.114469 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d34a1ae-3e14-40bd-9d09-a882c6b39422 None admin] RBAC: Authorization granted {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:05:37.114849 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-959e1a87-ca88-4fb9-af19-77679af2636c None admin] RBAC: Adding query filter params (name=admin) {{(pid=88551) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 19:05:37.115178 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-959e1a87-ca88-4fb9-af19-77679af2636c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:05:37.117330 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-959e1a87-ca88-4fb9-af19-77679af2636c None admin] RBAC: Authorization granted {{(pid=88551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:05:37.127519 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: [pid: 88550|app: 0|req: 97/194] 10.222.0.26 () {56 vars in 1101 bytes} [Wed Aug 17 19:05:36 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 19:05:37.127519 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d34a1ae-3e14-40bd-9d09-a882c6b39422 None admin] Authenticating user token {{(pid=88550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:05:37.127804 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: [pid: 88551|app: 0|req: 98/195] 10.222.0.26 () {56 vars in 1099 bytes} [Wed Aug 17 19:05:36 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 19:05:37.132853 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-959e1a87-ca88-4fb9-af19-77679af2636c None admin] Authenticating user token {{(pid=88551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:05:37.160569 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG dbcounter [-] [88550] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:05:37.213284 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG dbcounter [-] [88551] Writing DB stats keystone:SELECT=100 {{(pid=88551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:05:37.260528 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d34a1ae-3e14-40bd-9d09-a882c6b39422 None admin] Validating token access rules against request {{(pid=88550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:05:37.286944 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-959e1a87-ca88-4fb9-af19-77679af2636c None admin] Validating token access rules against request {{(pid=88551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:05:37.305867 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96e54f33-4b5f-4424-ba87-c010ac7d7218 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '819d41a279e64291acc60de51e1530ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:05:37.307020 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e54f33-4b5f-4424-ba87-c010ac7d7218 None admin] REQUEST_METHOD: `GET` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:05:37.307130 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e54f33-4b5f-4424-ba87-c010ac7d7218 None admin] SCRIPT_NAME: `/identity` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:05:37.307404 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e54f33-4b5f-4424-ba87-c010ac7d7218 None admin] PATH_INFO: `/v3/roles` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:05:37.308125 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96e54f33-4b5f-4424-ba87-c010ac7d7218 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=88550) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 19:05:37.308447 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96e54f33-4b5f-4424-ba87-c010ac7d7218 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:05:37.310174 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96e54f33-4b5f-4424-ba87-c010ac7d7218 None admin] RBAC: Authorization granted {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:05:37.322973 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: [pid: 88550|app: 0|req: 98/196] 10.222.0.26 () {56 vars in 1111 bytes} [Wed Aug 17 19:05:37 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 19:05:37.323875 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96e54f33-4b5f-4424-ba87-c010ac7d7218 None admin] Authenticating user token {{(pid=88550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:05:37.332543 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4fd6a5e-cc7b-4e38-8ac9-a40ffba7e48d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '819d41a279e64291acc60de51e1530ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:05:37.333307 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4fd6a5e-cc7b-4e38-8ac9-a40ffba7e48d None admin] REQUEST_METHOD: `GET` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:05:37.333690 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4fd6a5e-cc7b-4e38-8ac9-a40ffba7e48d None admin] SCRIPT_NAME: `/identity` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:05:37.334075 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4fd6a5e-cc7b-4e38-8ac9-a40ffba7e48d None admin] PATH_INFO: `/v3/users/f87943b9197d404ab09ed28087048ce9` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:05:37.335377 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4fd6a5e-cc7b-4e38-8ac9-a40ffba7e48d None admin] RBAC: Authorizing `identity:get_user(user_id=f87943b9197d404ab09ed28087048ce9)` {{(pid=88551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:05:37.336917 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4fd6a5e-cc7b-4e38-8ac9-a40ffba7e48d None admin] RBAC: Authorization granted {{(pid=88551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:05:37.339172 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: [pid: 88551|app: 0|req: 99/197] 10.222.0.26 () {56 vars in 1177 bytes} [Wed Aug 17 19:05:37 2022] GET /identity/v3/users/f87943b9197d404ab09ed28087048ce9 => generated 289 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 17 19:05:37.340443 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4fd6a5e-cc7b-4e38-8ac9-a40ffba7e48d None admin] Authenticating user token {{(pid=88551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:05:37.424652 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG dbcounter [-] [88550] Writing DB stats keystone:SELECT=100 {{(pid=88550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:05:37.440833 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96e54f33-4b5f-4424-ba87-c010ac7d7218 None admin] Validating token access rules against request {{(pid=88550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:05:37.476291 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee517c32-8455-4dae-8bdb-b662c6f3cd23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '819d41a279e64291acc60de51e1530ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:05:37.477052 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee517c32-8455-4dae-8bdb-b662c6f3cd23 None admin] REQUEST_METHOD: `GET` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:05:37.477420 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee517c32-8455-4dae-8bdb-b662c6f3cd23 None admin] SCRIPT_NAME: `/identity` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:05:37.477752 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee517c32-8455-4dae-8bdb-b662c6f3cd23 None admin] PATH_INFO: `/v3/users/5fef04c5e3ba470cab48fee3dc0eb32a` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:05:37.487968 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4fd6a5e-cc7b-4e38-8ac9-a40ffba7e48d None admin] Validating token access rules against request {{(pid=88551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:05:37.493277 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee517c32-8455-4dae-8bdb-b662c6f3cd23 None admin] RBAC: Authorizing `identity:get_user(user_id=5fef04c5e3ba470cab48fee3dc0eb32a)` {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:05:37.495172 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee517c32-8455-4dae-8bdb-b662c6f3cd23 None admin] RBAC: Authorization granted {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:05:37.497009 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: [pid: 88550|app: 0|req: 99/198] 10.222.0.26 () {56 vars in 1177 bytes} [Wed Aug 17 19:05:37 2022] GET /identity/v3/users/5fef04c5e3ba470cab48fee3dc0eb32a => generated 283 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 19:05:37.497878 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee517c32-8455-4dae-8bdb-b662c6f3cd23 None admin] Authenticating user token {{(pid=88550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:05:37.518916 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG dbcounter [-] [88551] Writing DB stats keystone:SELECT=100 {{(pid=88551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:05:37.534089 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69fab4ec-94fc-4fd9-9a10-fd0dfbf583c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '819d41a279e64291acc60de51e1530ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:05:37.534950 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69fab4ec-94fc-4fd9-9a10-fd0dfbf583c8 None admin] REQUEST_METHOD: `GET` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:05:37.535247 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69fab4ec-94fc-4fd9-9a10-fd0dfbf583c8 None admin] SCRIPT_NAME: `/identity` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:05:37.535632 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69fab4ec-94fc-4fd9-9a10-fd0dfbf583c8 None admin] PATH_INFO: `/v3/users/5fef04c5e3ba470cab48fee3dc0eb32a` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:05:37.537689 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69fab4ec-94fc-4fd9-9a10-fd0dfbf583c8 None admin] RBAC: Authorizing `identity:get_user(user_id=5fef04c5e3ba470cab48fee3dc0eb32a)` {{(pid=88551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:05:37.539265 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69fab4ec-94fc-4fd9-9a10-fd0dfbf583c8 None admin] RBAC: Authorization granted {{(pid=88551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:05:37.541327 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: [pid: 88551|app: 0|req: 100/199] 10.222.0.26 () {56 vars in 1177 bytes} [Wed Aug 17 19:05:37 2022] GET /identity/v3/users/5fef04c5e3ba470cab48fee3dc0eb32a => generated 283 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 19:05:37.542384 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69fab4ec-94fc-4fd9-9a10-fd0dfbf583c8 None admin] Authenticating user token {{(pid=88551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:05:37.616640 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee517c32-8455-4dae-8bdb-b662c6f3cd23 None admin] Validating token access rules against request {{(pid=88550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:05:37.661889 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69fab4ec-94fc-4fd9-9a10-fd0dfbf583c8 None admin] Validating token access rules against request {{(pid=88551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:05:37.668256 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e8ff19b-ccd5-46ef-aa89-d82b2d1d44f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '819d41a279e64291acc60de51e1530ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:05:37.668980 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e8ff19b-ccd5-46ef-aa89-d82b2d1d44f3 None admin] REQUEST_METHOD: `GET` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:05:37.669420 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e8ff19b-ccd5-46ef-aa89-d82b2d1d44f3 None admin] SCRIPT_NAME: `/identity` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:05:37.670318 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e8ff19b-ccd5-46ef-aa89-d82b2d1d44f3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:05:37.685557 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG dbcounter [-] [88550] Writing DB stats keystone:SELECT=100 {{(pid=88550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:05:37.700632 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90347b32-8e68-4547-b661-0b39d9d8f072 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '819d41a279e64291acc60de51e1530ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:05:37.701278 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90347b32-8e68-4547-b661-0b39d9d8f072 None admin] REQUEST_METHOD: `GET` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:05:37.701571 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90347b32-8e68-4547-b661-0b39d9d8f072 None admin] SCRIPT_NAME: `/identity` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:05:37.701869 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90347b32-8e68-4547-b661-0b39d9d8f072 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:05:37.754257 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e8ff19b-ccd5-46ef-aa89-d82b2d1d44f3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:05:37.756166 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e8ff19b-ccd5-46ef-aa89-d82b2d1d44f3 None admin] RBAC: Authorization granted {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:05:37.777645 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG dbcounter [-] [88551] Writing DB stats keystone:SELECT=100 {{(pid=88551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:05:37.792744 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90347b32-8e68-4547-b661-0b39d9d8f072 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:05:37.794213 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90347b32-8e68-4547-b661-0b39d9d8f072 None admin] RBAC: Authorization granted {{(pid=88551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:05:37.873037 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: [pid: 88550|app: 0|req: 100/200] 10.222.0.26 () {58 vars in 1282 bytes} [Wed Aug 17 19:05:37 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 375 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 17 19:05:37.879264 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e8ff19b-ccd5-46ef-aa89-d82b2d1d44f3 None admin] Authenticating user token {{(pid=88550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:05:37.923284 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG dbcounter [-] [88550] Writing DB stats keystone:SELECT=100 {{(pid=88550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:05:37.930631 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: [pid: 88551|app: 0|req: 101/201] 10.222.0.26 () {58 vars in 1282 bytes} [Wed Aug 17 19:05:37 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 388 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 17 19:05:37.931747 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90347b32-8e68-4547-b661-0b39d9d8f072 None admin] Authenticating user token {{(pid=88551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:05:37.998600 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e8ff19b-ccd5-46ef-aa89-d82b2d1d44f3 None admin] Validating token access rules against request {{(pid=88550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:05:38.045833 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32f24381-2846-439a-865a-dfb318249565 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '819d41a279e64291acc60de51e1530ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:05:38.046885 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f24381-2846-439a-865a-dfb318249565 None admin] REQUEST_METHOD: `GET` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:05:38.047548 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f24381-2846-439a-865a-dfb318249565 None admin] SCRIPT_NAME: `/identity` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:05:38.048051 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f24381-2846-439a-865a-dfb318249565 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:05:38.054274 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG dbcounter [-] [88551] Writing DB stats keystone:SELECT=100 {{(pid=88551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:05:38.069894 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90347b32-8e68-4547-b661-0b39d9d8f072 None admin] Validating token access rules against request {{(pid=88551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:05:38.116556 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e71793d-328f-42f5-af22-8ae613247207 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '819d41a279e64291acc60de51e1530ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:05:38.117647 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e71793d-328f-42f5-af22-8ae613247207 None admin] REQUEST_METHOD: `GET` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:05:38.118198 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e71793d-328f-42f5-af22-8ae613247207 None admin] SCRIPT_NAME: `/identity` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:05:38.119310 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e71793d-328f-42f5-af22-8ae613247207 None admin] PATH_INFO: `/v3/projects/143eeb5624b2449582a0739926bcb8e1` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:05:38.121024 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e71793d-328f-42f5-af22-8ae613247207 None admin] RBAC: Authorizing `identity:get_project(project_id=143eeb5624b2449582a0739926bcb8e1)` {{(pid=88551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:05:38.123827 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e71793d-328f-42f5-af22-8ae613247207 None admin] RBAC: Authorization granted {{(pid=88551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:05:38.129479 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: [pid: 88551|app: 0|req: 102/202] 10.222.0.26 () {56 vars in 1186 bytes} [Wed Aug 17 19:05:37 2022] GET /identity/v3/projects/143eeb5624b2449582a0739926bcb8e1 => generated 298 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 19:05:38.131090 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e71793d-328f-42f5-af22-8ae613247207 None admin] Authenticating user token {{(pid=88551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:05:38.145170 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32f24381-2846-439a-865a-dfb318249565 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:05:38.147450 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32f24381-2846-439a-865a-dfb318249565 None admin] RBAC: Authorization granted {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:05:38.198571 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG dbcounter [-] [88550] Writing DB stats keystone:SELECT=100 {{(pid=88550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:05:38.242252 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e71793d-328f-42f5-af22-8ae613247207 None admin] Validating token access rules against request {{(pid=88551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:05:38.278904 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: [pid: 88550|app: 0|req: 101/203] 10.222.0.26 () {58 vars in 1282 bytes} [Wed Aug 17 19:05:37 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 400 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 17 19:05:38.280262 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32f24381-2846-439a-865a-dfb318249565 None admin] Authenticating user token {{(pid=88550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:05:38.280425 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9abbf6f7-029d-4d19-acf1-b5db607e7ab7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '819d41a279e64291acc60de51e1530ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:05:38.281199 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9abbf6f7-029d-4d19-acf1-b5db607e7ab7 None admin] REQUEST_METHOD: `GET` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:05:38.281646 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9abbf6f7-029d-4d19-acf1-b5db607e7ab7 None admin] SCRIPT_NAME: `/identity` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:05:38.282093 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9abbf6f7-029d-4d19-acf1-b5db607e7ab7 None admin] PATH_INFO: `/v3/projects/4ebe56b7d67e4584afee4a218097f2b4` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:05:38.283467 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9abbf6f7-029d-4d19-acf1-b5db607e7ab7 None admin] RBAC: Authorizing `identity:get_project(project_id=4ebe56b7d67e4584afee4a218097f2b4)` {{(pid=88551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:05:38.285041 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9abbf6f7-029d-4d19-acf1-b5db607e7ab7 None admin] RBAC: Authorization granted {{(pid=88551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:05:38.287144 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: [pid: 88551|app: 0|req: 103/204] 10.222.0.26 () {56 vars in 1186 bytes} [Wed Aug 17 19:05:38 2022] GET /identity/v3/projects/4ebe56b7d67e4584afee4a218097f2b4 => generated 302 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 19:05:38.288067 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9abbf6f7-029d-4d19-acf1-b5db607e7ab7 None admin] Authenticating user token {{(pid=88551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:05:38.314275 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG dbcounter [-] [88551] Writing DB stats keystone:SELECT=100 {{(pid=88551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:05:38.396276 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9abbf6f7-029d-4d19-acf1-b5db607e7ab7 None admin] Validating token access rules against request {{(pid=88551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:05:38.424835 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32f24381-2846-439a-865a-dfb318249565 None admin] Validating token access rules against request {{(pid=88550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:05:38.439873 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8722eab-bc57-40f6-bcac-2b040c795404 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '819d41a279e64291acc60de51e1530ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:05:38.440539 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8722eab-bc57-40f6-bcac-2b040c795404 None admin] REQUEST_METHOD: `GET` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:05:38.440832 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8722eab-bc57-40f6-bcac-2b040c795404 None admin] SCRIPT_NAME: `/identity` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:05:38.441153 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8722eab-bc57-40f6-bcac-2b040c795404 None admin] PATH_INFO: `/v3/projects/4ebe56b7d67e4584afee4a218097f2b4` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:05:38.442507 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8722eab-bc57-40f6-bcac-2b040c795404 None admin] RBAC: Authorizing `identity:get_project(project_id=4ebe56b7d67e4584afee4a218097f2b4)` {{(pid=88551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:05:38.444182 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8722eab-bc57-40f6-bcac-2b040c795404 None admin] RBAC: Authorization granted {{(pid=88551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:05:38.446016 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: [pid: 88551|app: 0|req: 104/205] 10.222.0.26 () {56 vars in 1186 bytes} [Wed Aug 17 19:05:38 2022] GET /identity/v3/projects/4ebe56b7d67e4584afee4a218097f2b4 => generated 302 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 19:05:38.446865 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8722eab-bc57-40f6-bcac-2b040c795404 None admin] Authenticating user token {{(pid=88551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:05:38.467612 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0de71ce7-44e9-479c-9099-dd39524c583f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '819d41a279e64291acc60de51e1530ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:05:38.468760 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de71ce7-44e9-479c-9099-dd39524c583f None admin] REQUEST_METHOD: `GET` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:05:38.469045 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de71ce7-44e9-479c-9099-dd39524c583f None admin] SCRIPT_NAME: `/identity` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:05:38.469315 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de71ce7-44e9-479c-9099-dd39524c583f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:05:38.470037 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0de71ce7-44e9-479c-9099-dd39524c583f None admin] RBAC: Adding query filter params (role.id=e46917e94e2e4018b346d95b26d804eb, scope.project.id=143eeb5624b2449582a0739926bcb8e1, user.id=f87943b9197d404ab09ed28087048ce9) {{(pid=88550) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 19:05:38.470343 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0de71ce7-44e9-479c-9099-dd39524c583f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:05:38.472291 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0de71ce7-44e9-479c-9099-dd39524c583f None admin] RBAC: Authorization granted {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:05:38.479091 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: [pid: 88550|app: 0|req: 102/206] 10.222.0.26 () {56 vars in 1374 bytes} [Wed Aug 17 19:05:38 2022] GET /identity/v3/role_assignments?user.id=f87943b9197d404ab09ed28087048ce9&scope.project.id=143eeb5624b2449582a0739926bcb8e1&role.id=e46917e94e2e4018b346d95b26d804eb => generated 608 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 19:05:38.479727 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0de71ce7-44e9-479c-9099-dd39524c583f None admin] Authenticating user token {{(pid=88550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:05:38.483383 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG dbcounter [-] [88550] Writing DB stats keystone:SELECT=100 {{(pid=88550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:05:38.595225 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0de71ce7-44e9-479c-9099-dd39524c583f None admin] Validating token access rules against request {{(pid=88550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:05:38.631715 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG dbcounter [-] [88551] Writing DB stats keystone:SELECT=100 {{(pid=88551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:05:38.635749 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c01bc04-c569-4119-a6dd-f8da0d57a6b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '819d41a279e64291acc60de51e1530ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:05:38.636544 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c01bc04-c569-4119-a6dd-f8da0d57a6b2 None admin] REQUEST_METHOD: `GET` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:05:38.637000 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c01bc04-c569-4119-a6dd-f8da0d57a6b2 None admin] SCRIPT_NAME: `/identity` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:05:38.637662 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c01bc04-c569-4119-a6dd-f8da0d57a6b2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:05:38.638666 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c01bc04-c569-4119-a6dd-f8da0d57a6b2 None admin] RBAC: Adding query filter params (role.id=60df6490940943d3b281ddaab1b0b9f7, scope.project.id=4ebe56b7d67e4584afee4a218097f2b4, user.id=5fef04c5e3ba470cab48fee3dc0eb32a) {{(pid=88550) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 19:05:38.639150 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c01bc04-c569-4119-a6dd-f8da0d57a6b2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:05:38.640872 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c01bc04-c569-4119-a6dd-f8da0d57a6b2 None admin] RBAC: Authorization granted {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:05:38.647763 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: [pid: 88550|app: 0|req: 103/207] 10.222.0.26 () {56 vars in 1374 bytes} [Wed Aug 17 19:05:38 2022] GET /identity/v3/role_assignments?user.id=5fef04c5e3ba470cab48fee3dc0eb32a&scope.project.id=4ebe56b7d67e4584afee4a218097f2b4&role.id=60df6490940943d3b281ddaab1b0b9f7 => generated 259 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 19:05:38.652960 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8722eab-bc57-40f6-bcac-2b040c795404 None admin] Validating token access rules against request {{(pid=88551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:05:38.719932 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6474a23c-a076-4777-b9b2-25bb05ed9ba0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '819d41a279e64291acc60de51e1530ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:05:38.720574 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6474a23c-a076-4777-b9b2-25bb05ed9ba0 None admin] REQUEST_METHOD: `GET` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:05:38.720817 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6474a23c-a076-4777-b9b2-25bb05ed9ba0 None admin] SCRIPT_NAME: `/identity` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:05:38.721086 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6474a23c-a076-4777-b9b2-25bb05ed9ba0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:05:38.721847 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6474a23c-a076-4777-b9b2-25bb05ed9ba0 None admin] RBAC: Adding query filter params (role.id=204f62ae18174b60a2e3f5d4f28ea326, scope.project.id=4ebe56b7d67e4584afee4a218097f2b4, user.id=5fef04c5e3ba470cab48fee3dc0eb32a) {{(pid=88551) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 19:05:38.722156 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6474a23c-a076-4777-b9b2-25bb05ed9ba0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:05:38.723661 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6474a23c-a076-4777-b9b2-25bb05ed9ba0 None admin] RBAC: Authorization granted {{(pid=88551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:05:38.736143 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: [pid: 88551|app: 0|req: 105/208] 10.222.0.26 () {56 vars in 1374 bytes} [Wed Aug 17 19:05:38 2022] GET /identity/v3/role_assignments?user.id=5fef04c5e3ba470cab48fee3dc0eb32a&scope.project.id=4ebe56b7d67e4584afee4a218097f2b4&role.id=204f62ae18174b60a2e3f5d4f28ea326 => generated 259 bytes in 289 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 19:05:39.366138 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a64a82-5d91-47c5-bc24-dc4ea6661e57 None None] REQUEST_METHOD: `GET` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:05:39.366682 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a64a82-5d91-47c5-bc24-dc4ea6661e57 None None] SCRIPT_NAME: `/identity` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:05:39.366757 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a64a82-5d91-47c5-bc24-dc4ea6661e57 None None] PATH_INFO: `/` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:05:39.368192 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: [pid: 88550|app: 0|req: 104/209] 10.222.0.26 () {54 vars in 927 bytes} [Wed Aug 17 19:05:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 19:05:39.378647 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2631997-c39f-42da-8d66-6ede241df280 None None] REQUEST_METHOD: `POST` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:05:39.378647 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2631997-c39f-42da-8d66-6ede241df280 None None] SCRIPT_NAME: `/identity` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:05:39.378647 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2631997-c39f-42da-8d66-6ede241df280 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:05:39.397423 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.auth.core [None req-f2631997-c39f-42da-8d66-6ede241df280 None None] MFA Rules not processed for user `819d41a279e64291acc60de51e1530ae`. Rule list: `[]` (Enabled: `True`). {{(pid=88551) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 19:05:39.399044 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.common.fernet_utils [None req-f2631997-c39f-42da-8d66-6ede241df280 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:05:39.470274 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: [pid: 88551|app: 0|req: 106/210] 10.222.0.26 () {58 vars in 1024 bytes} [Wed Aug 17 19:05:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 17 19:05:39.552904 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c33e167e-8686-4b9f-a59f-68dd1fffaf7b None None] REQUEST_METHOD: `GET` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:05:39.553209 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c33e167e-8686-4b9f-a59f-68dd1fffaf7b None None] SCRIPT_NAME: `/identity` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:05:39.553468 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c33e167e-8686-4b9f-a59f-68dd1fffaf7b None None] PATH_INFO: `/` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:05:39.554853 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: [pid: 88550|app: 0|req: 105/211] 10.222.0.26 () {54 vars in 927 bytes} [Wed Aug 17 19:05:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 19:05:39.560696 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-350423e4-04b2-43fb-b9d0-3917e6ab6bc7 None None] REQUEST_METHOD: `POST` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:05:39.561037 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-350423e4-04b2-43fb-b9d0-3917e6ab6bc7 None None] SCRIPT_NAME: `/identity` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:05:39.561318 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-350423e4-04b2-43fb-b9d0-3917e6ab6bc7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:05:39.580298 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.auth.core [None req-350423e4-04b2-43fb-b9d0-3917e6ab6bc7 None None] MFA Rules not processed for user `819d41a279e64291acc60de51e1530ae`. Rule list: `[]` (Enabled: `True`). {{(pid=88551) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 19:05:39.581492 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.common.fernet_utils [None req-350423e4-04b2-43fb-b9d0-3917e6ab6bc7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:05:39.651022 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: [pid: 88551|app: 0|req: 107/212] 10.222.0.26 () {58 vars in 1024 bytes} [Wed Aug 17 19:05:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 17 19:05:39.810115 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c33e167e-8686-4b9f-a59f-68dd1fffaf7b None None] Authenticating user token {{(pid=88550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:05:39.886700 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG dbcounter [-] [88550] Writing DB stats keystone:SELECT=100 {{(pid=88550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:05:39.927444 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c33e167e-8686-4b9f-a59f-68dd1fffaf7b None None] Validating token access rules against request {{(pid=88550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:05:39.966559 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d97ab992-4f59-40c3-97f3-c217f98aa8b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '819d41a279e64291acc60de51e1530ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:05:39.967234 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d97ab992-4f59-40c3-97f3-c217f98aa8b9 None admin] REQUEST_METHOD: `GET` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:05:39.967515 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d97ab992-4f59-40c3-97f3-c217f98aa8b9 None admin] SCRIPT_NAME: `/identity` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:05:39.967789 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d97ab992-4f59-40c3-97f3-c217f98aa8b9 None admin] PATH_INFO: `/v3/roles/member` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:05:39.980003 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d97ab992-4f59-40c3-97f3-c217f98aa8b9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 17 19:05:39.986012 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application [None req-d97ab992-4f59-40c3-97f3-c217f98aa8b9 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 17 19:05:39.986012 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 19:05:39.986012 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 19:05:39.986012 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 19:05:39.986012 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 19:05:39.986012 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 19:05:39.986012 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 19:05:39.986012 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 19:05:39.986012 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 19:05:39.986012 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 19:05:39.986012 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 19:05:39.986012 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 19:05:39.986012 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 17 19:05:39.986012 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 17 19:05:39.986012 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 17 19:05:39.986012 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 17 19:05:39.986928 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 17 19:05:39.986928 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 17 19:05:39.986928 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 17 19:05:39.986928 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 17 19:05:39.986928 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 19:05:39.986928 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 19:05:39.986928 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 19:05:39.986928 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 19:05:39.986928 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 19:05:39.986928 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 19:05:39.986928 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 19:05:39.986928 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application with Lock( Aug 17 19:05:39.986928 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 19:05:39.986928 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return self._enter() Aug 17 19:05:39.986928 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 19:05:39.986928 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 19:05:39.988274 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 19:05:39.988274 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return self.creator() Aug 17 19:05:39.988274 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 19:05:39.988274 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application created_value = creator( Aug 17 19:05:39.988274 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 17 19:05:39.988274 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 17 19:05:39.988274 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 17 19:05:39.988274 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 17 19:05:39.988274 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 17 19:05:39.988274 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 17 19:05:39.988274 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 17 19:05:39.988274 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application Aug 17 19:05:39.988274 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: [pid: 88550|app: 0|req: 106/213] 10.222.0.26 () {56 vars in 1099 bytes} [Wed Aug 17 19:05:39 2022] GET /identity/v3/roles/member => generated 84 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 19:05:39.995030 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-350423e4-04b2-43fb-b9d0-3917e6ab6bc7 None None] Authenticating user token {{(pid=88551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:05:39.999158 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d97ab992-4f59-40c3-97f3-c217f98aa8b9 None admin] Authenticating user token {{(pid=88550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:05:40.014187 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG dbcounter [-] [88551] Writing DB stats keystone:SELECT=100 {{(pid=88551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:05:40.112328 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d97ab992-4f59-40c3-97f3-c217f98aa8b9 None admin] Validating token access rules against request {{(pid=88550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:05:40.124240 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-350423e4-04b2-43fb-b9d0-3917e6ab6bc7 None None] Validating token access rules against request {{(pid=88551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:05:40.142230 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG dbcounter [-] [88550] Writing DB stats keystone:SELECT=100 {{(pid=88550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:05:40.150900 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2d29158-e576-4e6e-9e34-651997629f3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '819d41a279e64291acc60de51e1530ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:05:40.151543 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d29158-e576-4e6e-9e34-651997629f3d None admin] REQUEST_METHOD: `GET` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:05:40.151823 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d29158-e576-4e6e-9e34-651997629f3d None admin] SCRIPT_NAME: `/identity` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:05:40.156578 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d29158-e576-4e6e-9e34-651997629f3d None admin] PATH_INFO: `/v3/domains/default` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:05:40.156578 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2d29158-e576-4e6e-9e34-651997629f3d None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:05:40.156578 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2d29158-e576-4e6e-9e34-651997629f3d None admin] RBAC: Authorization granted {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:05:40.157436 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: [pid: 88550|app: 0|req: 107/214] 10.222.0.26 () {56 vars in 1108 bytes} [Wed Aug 17 19:05:39 2022] GET /identity/v3/domains/default => generated 199 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 19:05:40.167646 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2d29158-e576-4e6e-9e34-651997629f3d None admin] Authenticating user token {{(pid=88550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:05:40.169950 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd129670-b7a5-4e86-874c-8523c17d1577 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '819d41a279e64291acc60de51e1530ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:05:40.171157 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd129670-b7a5-4e86-874c-8523c17d1577 None admin] REQUEST_METHOD: `GET` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:05:40.172497 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd129670-b7a5-4e86-874c-8523c17d1577 None admin] SCRIPT_NAME: `/identity` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:05:40.172979 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd129670-b7a5-4e86-874c-8523c17d1577 None admin] PATH_INFO: `/v3/roles` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:05:40.173848 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd129670-b7a5-4e86-874c-8523c17d1577 None admin] RBAC: Adding query filter params (name=member) {{(pid=88551) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 19:05:40.174367 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd129670-b7a5-4e86-874c-8523c17d1577 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:05:40.176052 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd129670-b7a5-4e86-874c-8523c17d1577 None admin] RBAC: Authorization granted {{(pid=88551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:05:40.191926 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: [pid: 88551|app: 0|req: 108/215] 10.222.0.26 () {56 vars in 1101 bytes} [Wed Aug 17 19:05:39 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 19:05:40.193107 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd129670-b7a5-4e86-874c-8523c17d1577 None admin] Authenticating user token {{(pid=88551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:05:40.298394 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG dbcounter [-] [88551] Writing DB stats keystone:SELECT=100 {{(pid=88551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:05:40.306590 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2d29158-e576-4e6e-9e34-651997629f3d None admin] Validating token access rules against request {{(pid=88550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:05:40.326078 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd129670-b7a5-4e86-874c-8523c17d1577 None admin] Validating token access rules against request {{(pid=88551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:05:40.353125 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ab6d522-235e-452a-9e2e-4f60a099aeae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '819d41a279e64291acc60de51e1530ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:05:40.354190 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab6d522-235e-452a-9e2e-4f60a099aeae None admin] REQUEST_METHOD: `POST` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:05:40.354490 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab6d522-235e-452a-9e2e-4f60a099aeae None admin] SCRIPT_NAME: `/identity` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:05:40.354791 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab6d522-235e-452a-9e2e-4f60a099aeae None admin] PATH_INFO: `/v3/users` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:05:40.355508 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ab6d522-235e-452a-9e2e-4f60a099aeae None admin] RBAC: Authorizing `identity:create_user()` {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:05:40.357429 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ab6d522-235e-452a-9e2e-4f60a099aeae None admin] RBAC: Authorization granted {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:05:40.369734 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05772d5c-e19f-49a9-8259-b35878c8306e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '819d41a279e64291acc60de51e1530ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:05:40.371558 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05772d5c-e19f-49a9-8259-b35878c8306e None admin] REQUEST_METHOD: `GET` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:05:40.372038 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05772d5c-e19f-49a9-8259-b35878c8306e None admin] SCRIPT_NAME: `/identity` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:05:40.372793 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05772d5c-e19f-49a9-8259-b35878c8306e None admin] PATH_INFO: `/v3/users/16b1dde65f2748e8934aa5345f0e5bb8` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:05:40.391529 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05772d5c-e19f-49a9-8259-b35878c8306e None admin] RBAC: Authorizing `identity:get_user(user_id=16b1dde65f2748e8934aa5345f0e5bb8)` {{(pid=88551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:05:40.393002 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05772d5c-e19f-49a9-8259-b35878c8306e None admin] RBAC: Authorization granted {{(pid=88551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:05:40.394998 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: [pid: 88551|app: 0|req: 109/216] 10.222.0.26 () {56 vars in 1177 bytes} [Wed Aug 17 19:05:40 2022] GET /identity/v3/users/16b1dde65f2748e8934aa5345f0e5bb8 => generated 297 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 19:05:40.400205 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05772d5c-e19f-49a9-8259-b35878c8306e None admin] Authenticating user token {{(pid=88551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:05:40.468755 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: [pid: 88550|app: 0|req: 108/217] 10.222.0.26 () {60 vars in 1132 bytes} [Wed Aug 17 19:05:40 2022] POST /identity/v3/users => generated 297 bytes in 301 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 19:05:40.522359 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05772d5c-e19f-49a9-8259-b35878c8306e None admin] Validating token access rules against request {{(pid=88551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:05:40.571992 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9dcbc3a-519a-454a-8758-8947ca80a40c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '819d41a279e64291acc60de51e1530ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:05:40.572980 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9dcbc3a-519a-454a-8758-8947ca80a40c None admin] REQUEST_METHOD: `GET` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:05:40.573560 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9dcbc3a-519a-454a-8758-8947ca80a40c None admin] SCRIPT_NAME: `/identity` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:05:40.574037 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9dcbc3a-519a-454a-8758-8947ca80a40c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:05:40.579351 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG dbcounter [-] [88551] Writing DB stats keystone:SELECT=100 {{(pid=88551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:05:40.658193 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9dcbc3a-519a-454a-8758-8947ca80a40c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:05:40.659996 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9dcbc3a-519a-454a-8758-8947ca80a40c None admin] RBAC: Authorization granted {{(pid=88551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:05:40.774862 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: [pid: 88551|app: 0|req: 110/218] 10.222.0.26 () {58 vars in 1282 bytes} [Wed Aug 17 19:05:40 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 375 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 17 19:05:40.781094 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ab6d522-235e-452a-9e2e-4f60a099aeae None admin] Authenticating user token {{(pid=88550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:05:40.847370 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG dbcounter [-] [88550] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:05:40.907018 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ab6d522-235e-452a-9e2e-4f60a099aeae None admin] Validating token access rules against request {{(pid=88550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:05:40.960724 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43ffcc41-299c-4c92-bd9f-2e80d3e8147a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '819d41a279e64291acc60de51e1530ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:05:40.961391 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ffcc41-299c-4c92-bd9f-2e80d3e8147a None admin] REQUEST_METHOD: `GET` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:05:40.961733 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ffcc41-299c-4c92-bd9f-2e80d3e8147a None admin] SCRIPT_NAME: `/identity` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:05:40.962019 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ffcc41-299c-4c92-bd9f-2e80d3e8147a None admin] PATH_INFO: `/v3/projects/4ebe56b7d67e4584afee4a218097f2b4` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:05:40.964020 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43ffcc41-299c-4c92-bd9f-2e80d3e8147a None admin] RBAC: Authorizing `identity:get_project(project_id=4ebe56b7d67e4584afee4a218097f2b4)` {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:05:40.965708 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43ffcc41-299c-4c92-bd9f-2e80d3e8147a None admin] RBAC: Authorization granted {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:05:40.967627 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: [pid: 88550|app: 0|req: 109/219] 10.222.0.26 () {56 vars in 1186 bytes} [Wed Aug 17 19:05:40 2022] GET /identity/v3/projects/4ebe56b7d67e4584afee4a218097f2b4 => generated 302 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 19:05:40.974009 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9dcbc3a-519a-454a-8758-8947ca80a40c None admin] Authenticating user token {{(pid=88551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:05:41.014676 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG dbcounter [-] [88551] Writing DB stats keystone:SELECT=100 {{(pid=88551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:05:41.086629 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9dcbc3a-519a-454a-8758-8947ca80a40c None admin] Validating token access rules against request {{(pid=88551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:05:41.094920 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac5906f-ae10-43fa-9908-0c8159651b95 None None] REQUEST_METHOD: `GET` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:05:41.095205 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac5906f-ae10-43fa-9908-0c8159651b95 None None] SCRIPT_NAME: `/identity` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:05:41.095482 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac5906f-ae10-43fa-9908-0c8159651b95 None None] PATH_INFO: `/` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:05:41.097084 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: [pid: 88550|app: 0|req: 110/220] 10.222.0.26 () {54 vars in 927 bytes} [Wed Aug 17 19:05:41 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 19:05:41.103042 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a7484e-c785-4ab3-9da7-0f5e2b8ef7ff None None] REQUEST_METHOD: `POST` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:05:41.103333 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a7484e-c785-4ab3-9da7-0f5e2b8ef7ff None None] SCRIPT_NAME: `/identity` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:05:41.103612 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a7484e-c785-4ab3-9da7-0f5e2b8ef7ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:05:41.123760 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.auth.core [None req-46a7484e-c785-4ab3-9da7-0f5e2b8ef7ff None None] MFA Rules not processed for user `819d41a279e64291acc60de51e1530ae`. Rule list: `[]` (Enabled: `True`). {{(pid=88550) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 19:05:41.126130 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.common.fernet_utils [None req-46a7484e-c785-4ab3-9da7-0f5e2b8ef7ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:05:41.134572 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f49ab005-4af4-47aa-b089-870c3a6ad8ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '819d41a279e64291acc60de51e1530ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:05:41.134572 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f49ab005-4af4-47aa-b089-870c3a6ad8ef None admin] REQUEST_METHOD: `GET` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:05:41.134572 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f49ab005-4af4-47aa-b089-870c3a6ad8ef None admin] SCRIPT_NAME: `/identity` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:05:41.134572 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f49ab005-4af4-47aa-b089-870c3a6ad8ef None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:05:41.135157 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f49ab005-4af4-47aa-b089-870c3a6ad8ef None admin] RBAC: Adding query filter params (role.id=748773430faa4030989e1e77b3f361e1, scope.project.id=4ebe56b7d67e4584afee4a218097f2b4, user.id=16b1dde65f2748e8934aa5345f0e5bb8) {{(pid=88551) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 19:05:41.135157 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f49ab005-4af4-47aa-b089-870c3a6ad8ef None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:05:41.135157 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f49ab005-4af4-47aa-b089-870c3a6ad8ef None admin] RBAC: Authorization granted {{(pid=88551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:05:41.144160 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: [pid: 88551|app: 0|req: 111/221] 10.222.0.26 () {56 vars in 1374 bytes} [Wed Aug 17 19:05:40 2022] GET /identity/v3/role_assignments?user.id=16b1dde65f2748e8934aa5345f0e5bb8&scope.project.id=4ebe56b7d67e4584afee4a218097f2b4&role.id=748773430faa4030989e1e77b3f361e1 => generated 259 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 19:05:41.145912 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc5b65b5-3bba-4bd2-9c1b-53a94a9c6274 None None] REQUEST_METHOD: `GET` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:05:41.146205 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc5b65b5-3bba-4bd2-9c1b-53a94a9c6274 None None] SCRIPT_NAME: `/identity` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:05:41.146479 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc5b65b5-3bba-4bd2-9c1b-53a94a9c6274 None None] PATH_INFO: `/` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:05:41.148175 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: [pid: 88551|app: 0|req: 112/222] 10.222.0.26 () {54 vars in 927 bytes} [Wed Aug 17 19:05:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 19:05:41.154884 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ed8b31-e432-42b3-a0b2-e4ef7576bfbf None None] REQUEST_METHOD: `POST` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:05:41.155225 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ed8b31-e432-42b3-a0b2-e4ef7576bfbf None None] SCRIPT_NAME: `/identity` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:05:41.155476 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ed8b31-e432-42b3-a0b2-e4ef7576bfbf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:05:41.191637 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.auth.core [None req-20ed8b31-e432-42b3-a0b2-e4ef7576bfbf None None] MFA Rules not processed for user `819d41a279e64291acc60de51e1530ae`. Rule list: `[]` (Enabled: `True`). {{(pid=88551) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 19:05:41.193213 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.common.fernet_utils [None req-20ed8b31-e432-42b3-a0b2-e4ef7576bfbf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:05:41.238448 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: [pid: 88550|app: 0|req: 111/223] 10.222.0.26 () {58 vars in 1024 bytes} [Wed Aug 17 19:05:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 17 19:05:41.310698 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: [pid: 88551|app: 0|req: 113/224] 10.222.0.26 () {58 vars in 1024 bytes} [Wed Aug 17 19:05:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 17 19:05:41.588625 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46a7484e-c785-4ab3-9da7-0f5e2b8ef7ff None None] Authenticating user token {{(pid=88550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:05:41.640388 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG dbcounter [-] [88550] Writing DB stats keystone:SELECT=100 {{(pid=88550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:05:41.677942 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20ed8b31-e432-42b3-a0b2-e4ef7576bfbf None None] Authenticating user token {{(pid=88551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:05:41.694525 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46a7484e-c785-4ab3-9da7-0f5e2b8ef7ff None None] Validating token access rules against request {{(pid=88550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:05:41.735147 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bc4714c-d87e-4804-aaf3-c3742e76a7aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '819d41a279e64291acc60de51e1530ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:05:41.735780 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc4714c-d87e-4804-aaf3-c3742e76a7aa None admin] REQUEST_METHOD: `GET` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:05:41.736053 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc4714c-d87e-4804-aaf3-c3742e76a7aa None admin] SCRIPT_NAME: `/identity` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:05:41.736322 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc4714c-d87e-4804-aaf3-c3742e76a7aa None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:05:41.739404 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG dbcounter [-] [88551] Writing DB stats keystone:SELECT=100 {{(pid=88551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:05:41.750756 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bc4714c-d87e-4804-aaf3-c3742e76a7aa None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 17 19:05:41.755754 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application [None req-8bc4714c-d87e-4804-aaf3-c3742e76a7aa None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 17 19:05:41.755754 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 19:05:41.755754 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 19:05:41.755754 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 19:05:41.755754 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 19:05:41.755754 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 19:05:41.755754 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 19:05:41.755754 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 19:05:41.755754 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 19:05:41.755754 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 19:05:41.755754 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 19:05:41.755754 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 19:05:41.755754 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 17 19:05:41.755754 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 17 19:05:41.755754 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 17 19:05:41.755754 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 17 19:05:41.759540 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 17 19:05:41.759540 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 17 19:05:41.759540 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 17 19:05:41.759540 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 17 19:05:41.759540 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 19:05:41.759540 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 19:05:41.759540 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 19:05:41.759540 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 19:05:41.759540 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 19:05:41.759540 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 19:05:41.759540 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 19:05:41.759540 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application with Lock( Aug 17 19:05:41.759540 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 19:05:41.759540 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return self._enter() Aug 17 19:05:41.759540 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 19:05:41.759540 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 19:05:41.760348 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 19:05:41.760348 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return self.creator() Aug 17 19:05:41.760348 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 19:05:41.760348 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application created_value = creator( Aug 17 19:05:41.760348 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 17 19:05:41.760348 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 17 19:05:41.760348 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 17 19:05:41.760348 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 17 19:05:41.760348 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 17 19:05:41.760348 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 17 19:05:41.760348 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 17 19:05:41.760348 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application Aug 17 19:05:41.760348 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: [pid: 88550|app: 0|req: 112/225] 10.222.0.26 () {56 vars in 1096 bytes} [Wed Aug 17 19:05:41 2022] GET /identity/v3/roles/admin => generated 83 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 19:05:41.763331 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bc4714c-d87e-4804-aaf3-c3742e76a7aa None admin] Authenticating user token {{(pid=88550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:05:41.872595 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20ed8b31-e432-42b3-a0b2-e4ef7576bfbf None None] Validating token access rules against request {{(pid=88551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:05:41.883530 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bc4714c-d87e-4804-aaf3-c3742e76a7aa None admin] Validating token access rules against request {{(pid=88550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:05:41.896080 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG dbcounter [-] [88550] Writing DB stats keystone:SELECT=100 {{(pid=88550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:05:41.923979 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21c7c3bb-315a-406f-a4e8-8353189025ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '819d41a279e64291acc60de51e1530ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:05:41.924588 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c7c3bb-315a-406f-a4e8-8353189025ce None admin] REQUEST_METHOD: `GET` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:05:41.925114 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c7c3bb-315a-406f-a4e8-8353189025ce None admin] SCRIPT_NAME: `/identity` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:05:41.925382 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c7c3bb-315a-406f-a4e8-8353189025ce None admin] PATH_INFO: `/v3/roles` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:05:41.926047 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21c7c3bb-315a-406f-a4e8-8353189025ce None admin] RBAC: Adding query filter params (name=admin) {{(pid=88550) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 19:05:41.926350 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21c7c3bb-315a-406f-a4e8-8353189025ce None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:05:41.927846 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21c7c3bb-315a-406f-a4e8-8353189025ce None admin] RBAC: Authorization granted {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:05:41.938575 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: [pid: 88550|app: 0|req: 113/226] 10.222.0.26 () {56 vars in 1099 bytes} [Wed Aug 17 19:05:41 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 17 19:05:41.945659 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21c7c3bb-315a-406f-a4e8-8353189025ce None admin] Authenticating user token {{(pid=88550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:05:41.965033 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79fecbb5-ed3f-4940-9a8c-b264849c8c1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '819d41a279e64291acc60de51e1530ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:05:41.965827 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79fecbb5-ed3f-4940-9a8c-b264849c8c1c None admin] REQUEST_METHOD: `GET` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:05:41.966109 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79fecbb5-ed3f-4940-9a8c-b264849c8c1c None admin] SCRIPT_NAME: `/identity` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:05:41.966379 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79fecbb5-ed3f-4940-9a8c-b264849c8c1c None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:05:41.993193 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79fecbb5-ed3f-4940-9a8c-b264849c8c1c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 17 19:05:41.998806 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application [None req-79fecbb5-ed3f-4940-9a8c-b264849c8c1c None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 17 19:05:41.998806 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 19:05:41.998806 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 19:05:41.998806 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 19:05:41.998806 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 19:05:41.998806 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 19:05:41.998806 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 19:05:41.998806 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 19:05:41.998806 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 19:05:41.998806 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 19:05:41.998806 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 19:05:41.998806 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 19:05:41.998806 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 17 19:05:41.998806 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 17 19:05:41.998806 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 17 19:05:41.998806 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 17 19:05:41.999811 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 17 19:05:41.999811 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 17 19:05:41.999811 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 17 19:05:41.999811 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 17 19:05:41.999811 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 19:05:41.999811 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 19:05:41.999811 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 19:05:41.999811 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 19:05:41.999811 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 19:05:41.999811 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 19:05:41.999811 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 19:05:41.999811 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application with Lock( Aug 17 19:05:41.999811 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 19:05:41.999811 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application return self._enter() Aug 17 19:05:41.999811 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 19:05:41.999811 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 19:05:42.000597 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 19:05:42.000597 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application return self.creator() Aug 17 19:05:42.000597 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 19:05:42.000597 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application created_value = creator( Aug 17 19:05:42.000597 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 17 19:05:42.000597 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 17 19:05:42.000597 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 17 19:05:42.000597 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 17 19:05:42.000597 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 17 19:05:42.000597 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 17 19:05:42.000597 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 17 19:05:42.000597 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application Aug 17 19:05:42.006478 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: [pid: 88551|app: 0|req: 114/227] 10.222.0.26 () {56 vars in 1114 bytes} [Wed Aug 17 19:05:41 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 329 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 17 19:05:42.012405 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79fecbb5-ed3f-4940-9a8c-b264849c8c1c None admin] Authenticating user token {{(pid=88551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:05:42.062386 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21c7c3bb-315a-406f-a4e8-8353189025ce None admin] Validating token access rules against request {{(pid=88550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:05:42.100853 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b0c6dbe-3906-4dee-9865-c86f3a8fd380 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '819d41a279e64291acc60de51e1530ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:05:42.101491 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b0c6dbe-3906-4dee-9865-c86f3a8fd380 None admin] REQUEST_METHOD: `GET` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:05:42.101775 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b0c6dbe-3906-4dee-9865-c86f3a8fd380 None admin] SCRIPT_NAME: `/identity` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:05:42.102052 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b0c6dbe-3906-4dee-9865-c86f3a8fd380 None admin] PATH_INFO: `/v3/users/5fef04c5e3ba470cab48fee3dc0eb32a` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:05:42.103242 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b0c6dbe-3906-4dee-9865-c86f3a8fd380 None admin] RBAC: Authorizing `identity:get_user(user_id=5fef04c5e3ba470cab48fee3dc0eb32a)` {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:05:42.105715 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b0c6dbe-3906-4dee-9865-c86f3a8fd380 None admin] RBAC: Authorization granted {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:05:42.107696 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: [pid: 88550|app: 0|req: 114/228] 10.222.0.26 () {56 vars in 1177 bytes} [Wed Aug 17 19:05:41 2022] GET /identity/v3/users/5fef04c5e3ba470cab48fee3dc0eb32a => generated 283 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 19:05:42.113552 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b0c6dbe-3906-4dee-9865-c86f3a8fd380 None admin] Authenticating user token {{(pid=88550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:05:42.160403 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG dbcounter [-] [88550] Writing DB stats keystone:SELECT=100 {{(pid=88550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:05:42.222569 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b0c6dbe-3906-4dee-9865-c86f3a8fd380 None admin] Validating token access rules against request {{(pid=88550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:05:42.257629 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG dbcounter [-] [88551] Writing DB stats keystone:SELECT=100 {{(pid=88551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:05:42.263336 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7134efc-853a-436b-9c63-9662d7282579 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '819d41a279e64291acc60de51e1530ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:05:42.263950 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7134efc-853a-436b-9c63-9662d7282579 None admin] REQUEST_METHOD: `GET` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:05:42.264232 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7134efc-853a-436b-9c63-9662d7282579 None admin] SCRIPT_NAME: `/identity` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:05:42.264508 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7134efc-853a-436b-9c63-9662d7282579 None admin] PATH_INFO: `/v3/projects/4ebe56b7d67e4584afee4a218097f2b4` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:05:42.266346 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7134efc-853a-436b-9c63-9662d7282579 None admin] RBAC: Authorizing `identity:get_project(project_id=4ebe56b7d67e4584afee4a218097f2b4)` {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:05:42.267843 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7134efc-853a-436b-9c63-9662d7282579 None admin] RBAC: Authorization granted {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:05:42.270610 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: [pid: 88550|app: 0|req: 115/229] 10.222.0.26 () {56 vars in 1186 bytes} [Wed Aug 17 19:05:42 2022] GET /identity/v3/projects/4ebe56b7d67e4584afee4a218097f2b4 => generated 302 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 19:05:42.277869 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7134efc-853a-436b-9c63-9662d7282579 None admin] Authenticating user token {{(pid=88550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:05:42.283138 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79fecbb5-ed3f-4940-9a8c-b264849c8c1c None admin] Validating token access rules against request {{(pid=88551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:05:42.357887 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b7eee19-2f95-4f83-b2a9-0cc4c05514c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '819d41a279e64291acc60de51e1530ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:05:42.359056 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b7eee19-2f95-4f83-b2a9-0cc4c05514c7 None admin] REQUEST_METHOD: `GET` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:05:42.359503 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b7eee19-2f95-4f83-b2a9-0cc4c05514c7 None admin] SCRIPT_NAME: `/identity` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:05:42.359783 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b7eee19-2f95-4f83-b2a9-0cc4c05514c7 None admin] PATH_INFO: `/v3/roles` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:05:42.360456 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b7eee19-2f95-4f83-b2a9-0cc4c05514c7 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=88551) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 19:05:42.360760 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b7eee19-2f95-4f83-b2a9-0cc4c05514c7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:05:42.362142 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b7eee19-2f95-4f83-b2a9-0cc4c05514c7 None admin] RBAC: Authorization granted {{(pid=88551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:05:42.379402 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: [pid: 88551|app: 0|req: 115/230] 10.222.0.26 () {56 vars in 1111 bytes} [Wed Aug 17 19:05:42 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 367 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 19:05:42.384472 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b7eee19-2f95-4f83-b2a9-0cc4c05514c7 None admin] Authenticating user token {{(pid=88551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:05:42.426297 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7134efc-853a-436b-9c63-9662d7282579 None admin] Validating token access rules against request {{(pid=88550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:05:42.436120 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG dbcounter [-] [88550] Writing DB stats keystone:SELECT=100 {{(pid=88550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:05:42.465029 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6592e386-876c-40a9-9309-c78e9275238a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '819d41a279e64291acc60de51e1530ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:05:42.465689 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6592e386-876c-40a9-9309-c78e9275238a None admin] REQUEST_METHOD: `PUT` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:05:42.466083 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6592e386-876c-40a9-9309-c78e9275238a None admin] SCRIPT_NAME: `/identity` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:05:42.466362 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6592e386-876c-40a9-9309-c78e9275238a None admin] PATH_INFO: `/v3/projects/4ebe56b7d67e4584afee4a218097f2b4/users/5fef04c5e3ba470cab48fee3dc0eb32a/roles/204f62ae18174b60a2e3f5d4f28ea326` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:05:42.468551 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6592e386-876c-40a9-9309-c78e9275238a None admin] RBAC: Authorizing `identity:create_grant(project_id=4ebe56b7d67e4584afee4a218097f2b4, user_id=5fef04c5e3ba470cab48fee3dc0eb32a, role_id=204f62ae18174b60a2e3f5d4f28ea326)` {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:05:42.470007 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6592e386-876c-40a9-9309-c78e9275238a None admin] RBAC: Authorization granted {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:05:42.531976 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b7eee19-2f95-4f83-b2a9-0cc4c05514c7 None admin] Validating token access rules against request {{(pid=88551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:05:42.542648 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: [pid: 88550|app: 0|req: 116/231] 10.222.0.26 () {58 vars in 1439 bytes} [Wed Aug 17 19:05:42 2022] PUT /identity/v3/projects/4ebe56b7d67e4584afee4a218097f2b4/users/5fef04c5e3ba470cab48fee3dc0eb32a/roles/204f62ae18174b60a2e3f5d4f28ea326 => generated 0 bytes in 265 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 19:05:42.579468 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-931e4a3e-d9ec-4394-82a5-685d12b3fdf0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '819d41a279e64291acc60de51e1530ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:05:42.580550 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-931e4a3e-d9ec-4394-82a5-685d12b3fdf0 None admin] REQUEST_METHOD: `GET` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:05:42.581027 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-931e4a3e-d9ec-4394-82a5-685d12b3fdf0 None admin] SCRIPT_NAME: `/identity` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:05:42.581542 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-931e4a3e-d9ec-4394-82a5-685d12b3fdf0 None admin] PATH_INFO: `/v3/users/5fef04c5e3ba470cab48fee3dc0eb32a` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:05:42.583170 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-931e4a3e-d9ec-4394-82a5-685d12b3fdf0 None admin] RBAC: Authorizing `identity:get_user(user_id=5fef04c5e3ba470cab48fee3dc0eb32a)` {{(pid=88551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:05:42.584952 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-931e4a3e-d9ec-4394-82a5-685d12b3fdf0 None admin] RBAC: Authorization granted {{(pid=88551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:05:42.586977 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: [pid: 88551|app: 0|req: 116/232] 10.222.0.26 () {56 vars in 1177 bytes} [Wed Aug 17 19:05:42 2022] GET /identity/v3/users/5fef04c5e3ba470cab48fee3dc0eb32a => generated 283 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 19:05:42.592713 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6592e386-876c-40a9-9309-c78e9275238a None admin] Authenticating user token {{(pid=88550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:05:42.731991 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6592e386-876c-40a9-9309-c78e9275238a None admin] Validating token access rules against request {{(pid=88550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:05:42.768821 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-263f973f-14de-4ed6-aca3-60b6b5c47e8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '819d41a279e64291acc60de51e1530ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:05:42.769511 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-263f973f-14de-4ed6-aca3-60b6b5c47e8e None admin] REQUEST_METHOD: `GET` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:05:42.769796 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-263f973f-14de-4ed6-aca3-60b6b5c47e8e None admin] SCRIPT_NAME: `/identity` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:05:42.770071 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-263f973f-14de-4ed6-aca3-60b6b5c47e8e None admin] PATH_INFO: `/v3/projects/4ebe56b7d67e4584afee4a218097f2b4` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:05:42.771233 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-263f973f-14de-4ed6-aca3-60b6b5c47e8e None admin] RBAC: Authorizing `identity:get_project(project_id=4ebe56b7d67e4584afee4a218097f2b4)` {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:05:42.772805 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-263f973f-14de-4ed6-aca3-60b6b5c47e8e None admin] RBAC: Authorization granted {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:05:42.774834 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: [pid: 88550|app: 0|req: 117/233] 10.222.0.26 () {56 vars in 1186 bytes} [Wed Aug 17 19:05:42 2022] GET /identity/v3/projects/4ebe56b7d67e4584afee4a218097f2b4 => generated 302 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 19:05:42.780848 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-931e4a3e-d9ec-4394-82a5-685d12b3fdf0 None admin] Authenticating user token {{(pid=88551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:05:42.816999 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG dbcounter [-] [88551] Writing DB stats keystone:SELECT=100 {{(pid=88551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:05:42.927158 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-931e4a3e-d9ec-4394-82a5-685d12b3fdf0 None admin] Validating token access rules against request {{(pid=88551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:05:42.973649 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e79caad3-2df4-45d9-9d73-29c2f28a0e1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '819d41a279e64291acc60de51e1530ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:05:42.974316 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79caad3-2df4-45d9-9d73-29c2f28a0e1e None admin] REQUEST_METHOD: `PUT` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:05:42.974632 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79caad3-2df4-45d9-9d73-29c2f28a0e1e None admin] SCRIPT_NAME: `/identity` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:05:42.974913 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79caad3-2df4-45d9-9d73-29c2f28a0e1e None admin] PATH_INFO: `/v3/projects/4ebe56b7d67e4584afee4a218097f2b4/users/5fef04c5e3ba470cab48fee3dc0eb32a/roles/60df6490940943d3b281ddaab1b0b9f7` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:05:42.977139 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e79caad3-2df4-45d9-9d73-29c2f28a0e1e None admin] RBAC: Authorizing `identity:create_grant(project_id=4ebe56b7d67e4584afee4a218097f2b4, user_id=5fef04c5e3ba470cab48fee3dc0eb32a, role_id=60df6490940943d3b281ddaab1b0b9f7)` {{(pid=88551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:05:42.978699 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e79caad3-2df4-45d9-9d73-29c2f28a0e1e None admin] RBAC: Authorization granted {{(pid=88551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:05:43.121854 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: [pid: 88551|app: 0|req: 117/234] 10.222.0.26 () {58 vars in 1439 bytes} [Wed Aug 17 19:05:42 2022] PUT /identity/v3/projects/4ebe56b7d67e4584afee4a218097f2b4/users/5fef04c5e3ba470cab48fee3dc0eb32a/roles/60df6490940943d3b281ddaab1b0b9f7 => generated 0 bytes in 342 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 19:05:43.350010 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6072d09-6e97-4c61-b88d-f5579676420d None None] REQUEST_METHOD: `GET` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:05:43.350554 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6072d09-6e97-4c61-b88d-f5579676420d None None] SCRIPT_NAME: `/identity` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:05:43.351010 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6072d09-6e97-4c61-b88d-f5579676420d None None] PATH_INFO: `/` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:05:43.352852 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: [pid: 88550|app: 0|req: 118/235] 10.222.0.26 () {54 vars in 927 bytes} [Wed Aug 17 19:05:43 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 19:05:43.357994 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3968a6ad-b0ed-4125-86d3-d6cba6961d3e None None] REQUEST_METHOD: `POST` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:05:43.359600 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3968a6ad-b0ed-4125-86d3-d6cba6961d3e None None] SCRIPT_NAME: `/identity` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:05:43.360147 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3968a6ad-b0ed-4125-86d3-d6cba6961d3e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:05:43.387780 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.auth.core [None req-3968a6ad-b0ed-4125-86d3-d6cba6961d3e None None] MFA Rules not processed for user `819d41a279e64291acc60de51e1530ae`. Rule list: `[]` (Enabled: `True`). {{(pid=88551) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 19:05:43.389352 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.common.fernet_utils [None req-3968a6ad-b0ed-4125-86d3-d6cba6961d3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:05:43.481603 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: [pid: 88551|app: 0|req: 118/236] 10.222.0.26 () {58 vars in 1024 bytes} [Wed Aug 17 19:05:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 17 19:05:43.701981 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a278fe9b-f92d-44b9-a1cd-ecec5a35c354 None None] REQUEST_METHOD: `GET` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:05:43.702506 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a278fe9b-f92d-44b9-a1cd-ecec5a35c354 None None] SCRIPT_NAME: `/identity` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:05:43.702506 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a278fe9b-f92d-44b9-a1cd-ecec5a35c354 None None] PATH_INFO: `/` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:05:43.704062 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: [pid: 88550|app: 0|req: 119/237] 10.222.0.26 () {54 vars in 927 bytes} [Wed Aug 17 19:05:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 19:05:43.716129 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-192b426e-7f82-4e41-b6b9-837169798647 None None] REQUEST_METHOD: `POST` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:05:43.716682 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-192b426e-7f82-4e41-b6b9-837169798647 None None] SCRIPT_NAME: `/identity` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:05:43.717153 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-192b426e-7f82-4e41-b6b9-837169798647 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:05:43.743887 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.auth.core [None req-192b426e-7f82-4e41-b6b9-837169798647 None None] MFA Rules not processed for user `819d41a279e64291acc60de51e1530ae`. Rule list: `[]` (Enabled: `True`). {{(pid=88551) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 19:05:43.745500 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.common.fernet_utils [None req-192b426e-7f82-4e41-b6b9-837169798647 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:05:43.749368 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG dbcounter [-] [88551] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:05:43.844528 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: [pid: 88551|app: 0|req: 119/238] 10.222.0.26 () {58 vars in 1024 bytes} [Wed Aug 17 19:05:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 17 19:05:43.908319 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-970c3962-c3ff-400e-915a-0d7fc3cdfcfd None None] REQUEST_METHOD: `GET` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:05:43.908635 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-970c3962-c3ff-400e-915a-0d7fc3cdfcfd None None] SCRIPT_NAME: `/identity` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:05:43.908873 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-970c3962-c3ff-400e-915a-0d7fc3cdfcfd None None] PATH_INFO: `/` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:05:43.910467 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: [pid: 88550|app: 0|req: 120/239] 10.222.0.26 () {54 vars in 927 bytes} [Wed Aug 17 19:05:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 19:05:43.915284 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c008f811-671e-427e-ae31-32e8de87cfa3 None None] REQUEST_METHOD: `POST` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:05:43.915562 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c008f811-671e-427e-ae31-32e8de87cfa3 None None] SCRIPT_NAME: `/identity` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:05:43.915833 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c008f811-671e-427e-ae31-32e8de87cfa3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:05:43.946872 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.auth.core [None req-c008f811-671e-427e-ae31-32e8de87cfa3 None None] MFA Rules not processed for user `819d41a279e64291acc60de51e1530ae`. Rule list: `[]` (Enabled: `True`). {{(pid=88551) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 19:05:43.950560 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.common.fernet_utils [None req-c008f811-671e-427e-ae31-32e8de87cfa3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:05:44.026425 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-970c3962-c3ff-400e-915a-0d7fc3cdfcfd None None] Authenticating user token {{(pid=88550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:05:44.069660 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: [pid: 88551|app: 0|req: 120/240] 10.222.0.26 () {58 vars in 1024 bytes} [Wed Aug 17 19:05:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 17 19:05:44.093231 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG dbcounter [-] [88550] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:05:44.194338 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-970c3962-c3ff-400e-915a-0d7fc3cdfcfd None None] Validating token access rules against request {{(pid=88550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:05:44.233781 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39b0c50e-663e-4b38-8c2f-088707686ec3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '819d41a279e64291acc60de51e1530ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:05:44.234412 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b0c50e-663e-4b38-8c2f-088707686ec3 None admin] REQUEST_METHOD: `GET` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:05:44.234724 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b0c50e-663e-4b38-8c2f-088707686ec3 None admin] SCRIPT_NAME: `/identity` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:05:44.234996 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b0c50e-663e-4b38-8c2f-088707686ec3 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:05:44.250005 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39b0c50e-663e-4b38-8c2f-088707686ec3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 17 19:05:44.255300 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application [None req-39b0c50e-663e-4b38-8c2f-088707686ec3 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 17 19:05:44.255300 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 19:05:44.255300 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 19:05:44.255300 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 19:05:44.255300 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 19:05:44.255300 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 19:05:44.255300 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 19:05:44.255300 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 19:05:44.255300 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 19:05:44.255300 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 19:05:44.255300 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 19:05:44.255300 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 19:05:44.255300 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 17 19:05:44.255300 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 17 19:05:44.255300 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 17 19:05:44.255300 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 17 19:05:44.256165 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 17 19:05:44.256165 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 17 19:05:44.256165 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 17 19:05:44.256165 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 17 19:05:44.256165 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 19:05:44.256165 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 19:05:44.256165 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 19:05:44.256165 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 19:05:44.256165 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 19:05:44.256165 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 19:05:44.256165 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 19:05:44.256165 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application with Lock( Aug 17 19:05:44.256165 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 19:05:44.256165 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return self._enter() Aug 17 19:05:44.256165 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 19:05:44.256165 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 19:05:44.257777 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 19:05:44.257777 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return self.creator() Aug 17 19:05:44.257777 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 19:05:44.257777 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application created_value = creator( Aug 17 19:05:44.257777 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 17 19:05:44.257777 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 17 19:05:44.257777 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 17 19:05:44.257777 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 17 19:05:44.257777 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 17 19:05:44.257777 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 17 19:05:44.257777 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 17 19:05:44.257777 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application Aug 17 19:05:44.257777 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: [pid: 88550|app: 0|req: 121/241] 10.222.0.26 () {56 vars in 1099 bytes} [Wed Aug 17 19:05:44 2022] GET /identity/v3/roles/reader => generated 84 bytes in 230 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 19:05:44.265746 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c008f811-671e-427e-ae31-32e8de87cfa3 None None] Authenticating user token {{(pid=88551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:05:44.286328 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39b0c50e-663e-4b38-8c2f-088707686ec3 None admin] Authenticating user token {{(pid=88550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:05:44.367174 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG dbcounter [-] [88551] Writing DB stats keystone:SELECT=100 {{(pid=88551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:05:44.401499 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c008f811-671e-427e-ae31-32e8de87cfa3 None None] Validating token access rules against request {{(pid=88551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:05:44.444865 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c5a7b5b-1807-4250-8cc9-07ef968ee25d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '819d41a279e64291acc60de51e1530ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:05:44.445478 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c5a7b5b-1807-4250-8cc9-07ef968ee25d None admin] REQUEST_METHOD: `GET` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:05:44.445754 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c5a7b5b-1807-4250-8cc9-07ef968ee25d None admin] SCRIPT_NAME: `/identity` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:05:44.446028 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c5a7b5b-1807-4250-8cc9-07ef968ee25d None admin] PATH_INFO: `/v3/roles` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:05:44.446335 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39b0c50e-663e-4b38-8c2f-088707686ec3 None admin] Validating token access rules against request {{(pid=88550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:05:44.446737 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c5a7b5b-1807-4250-8cc9-07ef968ee25d None admin] RBAC: Adding query filter params (name=reader) {{(pid=88551) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 19:05:44.447041 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c5a7b5b-1807-4250-8cc9-07ef968ee25d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:05:44.449357 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c5a7b5b-1807-4250-8cc9-07ef968ee25d None admin] RBAC: Authorization granted {{(pid=88551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:05:44.458996 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG dbcounter [-] [88550] Writing DB stats keystone:SELECT=100 {{(pid=88550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:05:44.459415 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: [pid: 88551|app: 0|req: 121/242] 10.222.0.26 () {56 vars in 1101 bytes} [Wed Aug 17 19:05:44 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 19:05:44.460259 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c5a7b5b-1807-4250-8cc9-07ef968ee25d None admin] Authenticating user token {{(pid=88551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:05:44.488831 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28199679-86a5-427d-a1b0-1b496b19f54b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '819d41a279e64291acc60de51e1530ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:05:44.489519 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28199679-86a5-427d-a1b0-1b496b19f54b None admin] REQUEST_METHOD: `GET` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:05:44.489804 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28199679-86a5-427d-a1b0-1b496b19f54b None admin] SCRIPT_NAME: `/identity` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:05:44.490276 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28199679-86a5-427d-a1b0-1b496b19f54b None admin] PATH_INFO: `/v3/domains/default` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:05:44.491832 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28199679-86a5-427d-a1b0-1b496b19f54b None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:05:44.493431 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28199679-86a5-427d-a1b0-1b496b19f54b None admin] RBAC: Authorization granted {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:05:44.495711 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: [pid: 88550|app: 0|req: 122/243] 10.222.0.26 () {56 vars in 1108 bytes} [Wed Aug 17 19:05:44 2022] GET /identity/v3/domains/default => generated 199 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 17 19:05:44.496764 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28199679-86a5-427d-a1b0-1b496b19f54b None admin] Authenticating user token {{(pid=88550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:05:44.580054 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c5a7b5b-1807-4250-8cc9-07ef968ee25d None admin] Validating token access rules against request {{(pid=88551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:05:44.664830 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG dbcounter [-] [88551] Writing DB stats keystone:SELECT=100 {{(pid=88551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:05:44.671842 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5c0036a-5202-4baf-8a18-b4d3dd5b03c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '819d41a279e64291acc60de51e1530ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:05:44.672880 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c0036a-5202-4baf-8a18-b4d3dd5b03c0 None admin] REQUEST_METHOD: `GET` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:05:44.673372 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c0036a-5202-4baf-8a18-b4d3dd5b03c0 None admin] SCRIPT_NAME: `/identity` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:05:44.673828 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c0036a-5202-4baf-8a18-b4d3dd5b03c0 None admin] PATH_INFO: `/v3/roles/member` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:05:44.685909 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5c0036a-5202-4baf-8a18-b4d3dd5b03c0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 17 19:05:44.691870 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application [None req-d5c0036a-5202-4baf-8a18-b4d3dd5b03c0 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 17 19:05:44.691870 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 19:05:44.691870 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 19:05:44.691870 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 19:05:44.691870 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 19:05:44.691870 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 19:05:44.691870 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 19:05:44.691870 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 19:05:44.691870 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 19:05:44.691870 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 19:05:44.691870 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 19:05:44.691870 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 19:05:44.691870 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 17 19:05:44.691870 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 17 19:05:44.691870 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 17 19:05:44.691870 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 17 19:05:44.692788 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 17 19:05:44.692788 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 17 19:05:44.692788 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 17 19:05:44.692788 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 17 19:05:44.692788 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 19:05:44.692788 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 19:05:44.692788 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 19:05:44.692788 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 19:05:44.692788 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 19:05:44.692788 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 19:05:44.692788 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 19:05:44.692788 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application with Lock( Aug 17 19:05:44.692788 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 19:05:44.692788 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application return self._enter() Aug 17 19:05:44.692788 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 19:05:44.692788 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 19:05:44.693623 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 19:05:44.693623 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application return self.creator() Aug 17 19:05:44.693623 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 19:05:44.693623 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application created_value = creator( Aug 17 19:05:44.693623 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 17 19:05:44.693623 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 17 19:05:44.693623 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 17 19:05:44.693623 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 17 19:05:44.693623 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 17 19:05:44.693623 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 17 19:05:44.693623 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 17 19:05:44.693623 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application Aug 17 19:05:44.696929 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: [pid: 88551|app: 0|req: 122/244] 10.222.0.26 () {56 vars in 1099 bytes} [Wed Aug 17 19:05:44 2022] GET /identity/v3/roles/member => generated 84 bytes in 237 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 19:05:44.698075 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5c0036a-5202-4baf-8a18-b4d3dd5b03c0 None admin] Authenticating user token {{(pid=88551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:05:44.708353 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28199679-86a5-427d-a1b0-1b496b19f54b None admin] Validating token access rules against request {{(pid=88550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:05:44.745615 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e8ecca2-6fe7-4670-99db-4a5aac45d876 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '819d41a279e64291acc60de51e1530ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:05:44.746246 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8ecca2-6fe7-4670-99db-4a5aac45d876 None admin] REQUEST_METHOD: `GET` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:05:44.746529 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8ecca2-6fe7-4670-99db-4a5aac45d876 None admin] SCRIPT_NAME: `/identity` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:05:44.746830 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8ecca2-6fe7-4670-99db-4a5aac45d876 None admin] PATH_INFO: `/v3/users/d3148b713c4c4b3b97030eea9ae825d9` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:05:44.761490 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e8ecca2-6fe7-4670-99db-4a5aac45d876 None admin] RBAC: Authorizing `identity:get_user(user_id=d3148b713c4c4b3b97030eea9ae825d9)` {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:05:44.763008 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e8ecca2-6fe7-4670-99db-4a5aac45d876 None admin] RBAC: Authorization granted {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:05:44.764697 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: [pid: 88550|app: 0|req: 123/245] 10.222.0.26 () {56 vars in 1177 bytes} [Wed Aug 17 19:05:44 2022] GET /identity/v3/users/d3148b713c4c4b3b97030eea9ae825d9 => generated 297 bytes in 268 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 19:05:44.765469 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e8ecca2-6fe7-4670-99db-4a5aac45d876 None admin] Authenticating user token {{(pid=88550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:05:44.790401 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG dbcounter [-] [88550] Writing DB stats keystone:SELECT=100 {{(pid=88550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:05:44.815487 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5c0036a-5202-4baf-8a18-b4d3dd5b03c0 None admin] Validating token access rules against request {{(pid=88551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:05:44.855690 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1ade5b7-e9d4-4536-beab-cb8d60c469f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '819d41a279e64291acc60de51e1530ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:05:44.856801 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ade5b7-e9d4-4536-beab-cb8d60c469f8 None admin] REQUEST_METHOD: `POST` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:05:44.857286 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ade5b7-e9d4-4536-beab-cb8d60c469f8 None admin] SCRIPT_NAME: `/identity` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:05:44.857754 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ade5b7-e9d4-4536-beab-cb8d60c469f8 None admin] PATH_INFO: `/v3/users` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:05:44.859204 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1ade5b7-e9d4-4536-beab-cb8d60c469f8 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=88551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:05:44.861084 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1ade5b7-e9d4-4536-beab-cb8d60c469f8 None admin] RBAC: Authorization granted {{(pid=88551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:05:44.869512 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e8ecca2-6fe7-4670-99db-4a5aac45d876 None admin] Validating token access rules against request {{(pid=88550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:05:44.904762 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63259bda-d8b3-4d7b-bb63-eac0ba8152fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '819d41a279e64291acc60de51e1530ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:05:44.905878 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63259bda-d8b3-4d7b-bb63-eac0ba8152fc None admin] REQUEST_METHOD: `GET` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:05:44.906155 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63259bda-d8b3-4d7b-bb63-eac0ba8152fc None admin] SCRIPT_NAME: `/identity` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:05:44.906424 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63259bda-d8b3-4d7b-bb63-eac0ba8152fc None admin] PATH_INFO: `/v3/roles` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:05:44.907133 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63259bda-d8b3-4d7b-bb63-eac0ba8152fc None admin] RBAC: Adding query filter params (name=member) {{(pid=88550) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 19:05:44.907533 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63259bda-d8b3-4d7b-bb63-eac0ba8152fc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:05:44.908880 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63259bda-d8b3-4d7b-bb63-eac0ba8152fc None admin] RBAC: Authorization granted {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:05:44.918127 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: [pid: 88550|app: 0|req: 124/246] 10.222.0.26 () {56 vars in 1101 bytes} [Wed Aug 17 19:05:44 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 19:05:44.922704 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63259bda-d8b3-4d7b-bb63-eac0ba8152fc None admin] Authenticating user token {{(pid=88550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:05:44.958572 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: [pid: 88551|app: 0|req: 123/247] 10.222.0.26 () {60 vars in 1132 bytes} [Wed Aug 17 19:05:44 2022] POST /identity/v3/users => generated 293 bytes in 261 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 19:05:44.960401 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1ade5b7-e9d4-4536-beab-cb8d60c469f8 None admin] Authenticating user token {{(pid=88551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:05:45.052859 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG dbcounter [-] [88551] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:05:45.087392 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG dbcounter [-] [88550] Writing DB stats keystone:SELECT=100 {{(pid=88550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:05:45.114690 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1ade5b7-e9d4-4536-beab-cb8d60c469f8 None admin] Validating token access rules against request {{(pid=88551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:05:45.137402 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63259bda-d8b3-4d7b-bb63-eac0ba8152fc None admin] Validating token access rules against request {{(pid=88550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:05:45.160033 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fff54d4a-dda2-40f9-a3f1-b5967bf5fbcc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '819d41a279e64291acc60de51e1530ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:05:45.161060 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff54d4a-dda2-40f9-a3f1-b5967bf5fbcc None admin] REQUEST_METHOD: `GET` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:05:45.161572 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff54d4a-dda2-40f9-a3f1-b5967bf5fbcc None admin] SCRIPT_NAME: `/identity` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:05:45.162044 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff54d4a-dda2-40f9-a3f1-b5967bf5fbcc None admin] PATH_INFO: `/v3/users/16b1dde65f2748e8934aa5345f0e5bb8` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:05:45.163645 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fff54d4a-dda2-40f9-a3f1-b5967bf5fbcc None admin] RBAC: Authorizing `identity:get_user(user_id=16b1dde65f2748e8934aa5345f0e5bb8)` {{(pid=88551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:05:45.165479 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fff54d4a-dda2-40f9-a3f1-b5967bf5fbcc None admin] RBAC: Authorization granted {{(pid=88551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:05:45.167488 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: [pid: 88551|app: 0|req: 124/248] 10.222.0.26 () {56 vars in 1177 bytes} [Wed Aug 17 19:05:44 2022] GET /identity/v3/users/16b1dde65f2748e8934aa5345f0e5bb8 => generated 297 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 19:05:45.175245 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fff54d4a-dda2-40f9-a3f1-b5967bf5fbcc None admin] Authenticating user token {{(pid=88551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:05:45.215946 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40b8836b-f1fc-4247-96d6-0cc45904096f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '819d41a279e64291acc60de51e1530ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:05:45.216811 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b8836b-f1fc-4247-96d6-0cc45904096f None admin] REQUEST_METHOD: `GET` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:05:45.217105 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b8836b-f1fc-4247-96d6-0cc45904096f None admin] SCRIPT_NAME: `/identity` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:05:45.217384 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b8836b-f1fc-4247-96d6-0cc45904096f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:05:45.303365 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40b8836b-f1fc-4247-96d6-0cc45904096f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:05:45.303749 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fff54d4a-dda2-40f9-a3f1-b5967bf5fbcc None admin] Validating token access rules against request {{(pid=88551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:05:45.305098 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40b8836b-f1fc-4247-96d6-0cc45904096f None admin] RBAC: Authorization granted {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:05:45.321889 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG dbcounter [-] [88551] Writing DB stats keystone:SELECT=100 {{(pid=88551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:05:45.341154 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63f56f1c-fbf7-4565-8e5f-545aeebd312a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '819d41a279e64291acc60de51e1530ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:05:45.342865 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f56f1c-fbf7-4565-8e5f-545aeebd312a None admin] REQUEST_METHOD: `GET` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:05:45.342865 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f56f1c-fbf7-4565-8e5f-545aeebd312a None admin] SCRIPT_NAME: `/identity` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:05:45.342865 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f56f1c-fbf7-4565-8e5f-545aeebd312a None admin] PATH_INFO: `/v3/projects/4ebe56b7d67e4584afee4a218097f2b4` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:05:45.344877 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63f56f1c-fbf7-4565-8e5f-545aeebd312a None admin] RBAC: Authorizing `identity:get_project(project_id=4ebe56b7d67e4584afee4a218097f2b4)` {{(pid=88551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:05:45.346624 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63f56f1c-fbf7-4565-8e5f-545aeebd312a None admin] RBAC: Authorization granted {{(pid=88551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:05:45.348788 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: [pid: 88551|app: 0|req: 125/249] 10.222.0.26 () {56 vars in 1186 bytes} [Wed Aug 17 19:05:45 2022] GET /identity/v3/projects/4ebe56b7d67e4584afee4a218097f2b4 => generated 302 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 17 19:05:45.357224 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63f56f1c-fbf7-4565-8e5f-545aeebd312a None admin] Authenticating user token {{(pid=88551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:05:45.423838 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG dbcounter [-] [88550] Writing DB stats keystone:SELECT=100 {{(pid=88550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:05:45.441723 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: [pid: 88550|app: 0|req: 125/250] 10.222.0.26 () {58 vars in 1282 bytes} [Wed Aug 17 19:05:44 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 523 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 17 19:05:45.443120 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6106716e-bfc9-438f-a824-bb2d168f4d37 None None] REQUEST_METHOD: `GET` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:05:45.443407 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6106716e-bfc9-438f-a824-bb2d168f4d37 None None] SCRIPT_NAME: `/identity` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:05:45.443684 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6106716e-bfc9-438f-a824-bb2d168f4d37 None None] PATH_INFO: `/` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:05:45.445168 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: [pid: 88550|app: 0|req: 126/251] 10.222.0.26 () {54 vars in 927 bytes} [Wed Aug 17 19:05:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 19:05:45.450849 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e75fbe-3077-40fb-94be-61bd11e36124 None None] REQUEST_METHOD: `POST` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:05:45.451241 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e75fbe-3077-40fb-94be-61bd11e36124 None None] SCRIPT_NAME: `/identity` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:05:45.451391 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e75fbe-3077-40fb-94be-61bd11e36124 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:05:45.479841 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.auth.core [None req-95e75fbe-3077-40fb-94be-61bd11e36124 None None] MFA Rules not processed for user `819d41a279e64291acc60de51e1530ae`. Rule list: `[]` (Enabled: `True`). {{(pid=88550) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 19:05:45.481156 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.common.fernet_utils [None req-95e75fbe-3077-40fb-94be-61bd11e36124 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:05:45.503032 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63f56f1c-fbf7-4565-8e5f-545aeebd312a None admin] Validating token access rules against request {{(pid=88551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:05:45.558423 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d9d0c86-c320-4b54-8fd7-c7cc6be656e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '819d41a279e64291acc60de51e1530ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:05:45.560234 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d9d0c86-c320-4b54-8fd7-c7cc6be656e2 None admin] REQUEST_METHOD: `PUT` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:05:45.561085 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d9d0c86-c320-4b54-8fd7-c7cc6be656e2 None admin] SCRIPT_NAME: `/identity` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:05:45.561596 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d9d0c86-c320-4b54-8fd7-c7cc6be656e2 None admin] PATH_INFO: `/v3/projects/4ebe56b7d67e4584afee4a218097f2b4/users/16b1dde65f2748e8934aa5345f0e5bb8/roles/748773430faa4030989e1e77b3f361e1` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:05:45.564740 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d9d0c86-c320-4b54-8fd7-c7cc6be656e2 None admin] RBAC: Authorizing `identity:create_grant(project_id=4ebe56b7d67e4584afee4a218097f2b4, user_id=16b1dde65f2748e8934aa5345f0e5bb8, role_id=748773430faa4030989e1e77b3f361e1)` {{(pid=88551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:05:45.566452 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d9d0c86-c320-4b54-8fd7-c7cc6be656e2 None admin] RBAC: Authorization granted {{(pid=88551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:05:45.575755 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: [pid: 88550|app: 0|req: 127/252] 10.222.0.26 () {58 vars in 1024 bytes} [Wed Aug 17 19:05:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 17 19:05:45.576497 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95e75fbe-3077-40fb-94be-61bd11e36124 None None] Authenticating user token {{(pid=88550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:05:45.693202 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95e75fbe-3077-40fb-94be-61bd11e36124 None None] Validating token access rules against request {{(pid=88550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:05:45.709118 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG dbcounter [-] [88550] Writing DB stats keystone:SELECT=100 {{(pid=88550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:05:45.737292 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-804a1935-8785-4b06-888a-b2ff20e21dd0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '819d41a279e64291acc60de51e1530ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:05:45.738237 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-804a1935-8785-4b06-888a-b2ff20e21dd0 None admin] REQUEST_METHOD: `GET` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:05:45.738745 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-804a1935-8785-4b06-888a-b2ff20e21dd0 None admin] SCRIPT_NAME: `/identity` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:05:45.739194 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-804a1935-8785-4b06-888a-b2ff20e21dd0 None admin] PATH_INFO: `/v3/projects/4ebe56b7d67e4584afee4a218097f2b4` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:05:45.740531 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-804a1935-8785-4b06-888a-b2ff20e21dd0 None admin] RBAC: Authorizing `identity:get_project(project_id=4ebe56b7d67e4584afee4a218097f2b4)` {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:05:45.742162 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-804a1935-8785-4b06-888a-b2ff20e21dd0 None admin] RBAC: Authorization granted {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:05:45.744049 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: [pid: 88550|app: 0|req: 128/253] 10.222.0.26 () {56 vars in 1186 bytes} [Wed Aug 17 19:05:45 2022] GET /identity/v3/projects/4ebe56b7d67e4584afee4a218097f2b4 => generated 302 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 19:05:45.756340 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: [pid: 88551|app: 0|req: 126/254] 10.222.0.26 () {58 vars in 1439 bytes} [Wed Aug 17 19:05:45 2022] PUT /identity/v3/projects/4ebe56b7d67e4584afee4a218097f2b4/users/16b1dde65f2748e8934aa5345f0e5bb8/roles/748773430faa4030989e1e77b3f361e1 => generated 0 bytes in 400 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 19:05:45.757186 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-804a1935-8785-4b06-888a-b2ff20e21dd0 None admin] Authenticating user token {{(pid=88550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:05:45.886885 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-804a1935-8785-4b06-888a-b2ff20e21dd0 None admin] Validating token access rules against request {{(pid=88550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:05:45.929230 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14eb9f20-b058-496e-a26b-8337f9ac2a8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '819d41a279e64291acc60de51e1530ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:05:45.930187 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14eb9f20-b058-496e-a26b-8337f9ac2a8b None admin] REQUEST_METHOD: `GET` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:05:45.930670 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14eb9f20-b058-496e-a26b-8337f9ac2a8b None admin] SCRIPT_NAME: `/identity` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:05:45.931107 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14eb9f20-b058-496e-a26b-8337f9ac2a8b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:05:45.932036 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14eb9f20-b058-496e-a26b-8337f9ac2a8b None admin] RBAC: Adding query filter params (role.id=e46917e94e2e4018b346d95b26d804eb, scope.project.id=4ebe56b7d67e4584afee4a218097f2b4, user.id=d3148b713c4c4b3b97030eea9ae825d9) {{(pid=88550) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 19:05:45.932506 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14eb9f20-b058-496e-a26b-8337f9ac2a8b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:05:45.942658 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14eb9f20-b058-496e-a26b-8337f9ac2a8b None admin] RBAC: Authorization granted {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:05:45.948316 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: [pid: 88550|app: 0|req: 129/255] 10.222.0.26 () {56 vars in 1374 bytes} [Wed Aug 17 19:05:45 2022] GET /identity/v3/role_assignments?user.id=d3148b713c4c4b3b97030eea9ae825d9&scope.project.id=4ebe56b7d67e4584afee4a218097f2b4&role.id=e46917e94e2e4018b346d95b26d804eb => generated 259 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 19:05:45.982043 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d9d0c86-c320-4b54-8fd7-c7cc6be656e2 None admin] Authenticating user token {{(pid=88551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:05:46.014900 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb717253-8002-485a-8e20-92a1381b2e23 None None] REQUEST_METHOD: `GET` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:05:46.015359 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb717253-8002-485a-8e20-92a1381b2e23 None None] SCRIPT_NAME: `/identity` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:05:46.015805 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb717253-8002-485a-8e20-92a1381b2e23 None None] PATH_INFO: `/` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:05:46.017709 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: [pid: 88550|app: 0|req: 130/256] 10.222.0.26 () {54 vars in 927 bytes} [Wed Aug 17 19:05:46 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 19:05:46.023816 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f41778d-c1f4-44de-9f5f-21cd2ce06d72 None None] REQUEST_METHOD: `POST` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:05:46.024241 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f41778d-c1f4-44de-9f5f-21cd2ce06d72 None None] SCRIPT_NAME: `/identity` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:05:46.024593 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f41778d-c1f4-44de-9f5f-21cd2ce06d72 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:05:46.044667 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.auth.core [None req-5f41778d-c1f4-44de-9f5f-21cd2ce06d72 None None] MFA Rules not processed for user `819d41a279e64291acc60de51e1530ae`. Rule list: `[]` (Enabled: `True`). {{(pid=88550) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 19:05:46.046405 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.common.fernet_utils [None req-5f41778d-c1f4-44de-9f5f-21cd2ce06d72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:05:46.059955 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG dbcounter [-] [88551] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:05:46.134872 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG dbcounter [-] [88550] Writing DB stats keystone:SELECT=100 {{(pid=88550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:05:46.178319 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d9d0c86-c320-4b54-8fd7-c7cc6be656e2 None admin] Validating token access rules against request {{(pid=88551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:05:46.195132 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: [pid: 88550|app: 0|req: 131/257] 10.222.0.26 () {58 vars in 1024 bytes} [Wed Aug 17 19:05:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 17 19:05:46.247440 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fa63152-f12a-47f5-a07d-21477fbb16cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '819d41a279e64291acc60de51e1530ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:05:46.248481 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa63152-f12a-47f5-a07d-21477fbb16cc None admin] REQUEST_METHOD: `GET` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:05:46.249092 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa63152-f12a-47f5-a07d-21477fbb16cc None admin] SCRIPT_NAME: `/identity` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:05:46.250071 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa63152-f12a-47f5-a07d-21477fbb16cc None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:05:46.264172 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fa63152-f12a-47f5-a07d-21477fbb16cc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 17 19:05:46.270224 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application [None req-5fa63152-f12a-47f5-a07d-21477fbb16cc None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 17 19:05:46.270224 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 19:05:46.270224 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 19:05:46.270224 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 19:05:46.270224 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 19:05:46.270224 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 19:05:46.270224 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 19:05:46.270224 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 19:05:46.270224 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 19:05:46.270224 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 19:05:46.270224 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 19:05:46.270224 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 19:05:46.270224 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 17 19:05:46.270224 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 17 19:05:46.270224 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 17 19:05:46.270224 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 17 19:05:46.271204 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 17 19:05:46.271204 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 17 19:05:46.271204 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 17 19:05:46.271204 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 17 19:05:46.271204 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 19:05:46.271204 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 19:05:46.271204 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 19:05:46.271204 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 19:05:46.271204 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 19:05:46.271204 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 19:05:46.271204 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 19:05:46.271204 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application with Lock( Aug 17 19:05:46.271204 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 19:05:46.271204 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application return self._enter() Aug 17 19:05:46.271204 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 19:05:46.271204 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 19:05:46.272027 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 19:05:46.272027 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application return self.creator() Aug 17 19:05:46.272027 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 19:05:46.272027 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application created_value = creator( Aug 17 19:05:46.272027 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 17 19:05:46.272027 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 17 19:05:46.272027 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 17 19:05:46.272027 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 17 19:05:46.272027 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 17 19:05:46.272027 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 17 19:05:46.272027 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 17 19:05:46.272027 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application Aug 17 19:05:46.274437 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: [pid: 88551|app: 0|req: 127/258] 10.222.0.26 () {56 vars in 1096 bytes} [Wed Aug 17 19:05:45 2022] GET /identity/v3/roles/admin => generated 83 bytes in 293 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 19:05:46.280387 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f41778d-c1f4-44de-9f5f-21cd2ce06d72 None None] Authenticating user token {{(pid=88550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:05:46.419331 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f41778d-c1f4-44de-9f5f-21cd2ce06d72 None None] Validating token access rules against request {{(pid=88550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:05:46.473272 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1edbd9ca-acac-45df-b2bb-dbb1400bb7ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '819d41a279e64291acc60de51e1530ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:05:46.473814 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1edbd9ca-acac-45df-b2bb-dbb1400bb7ad None admin] REQUEST_METHOD: `GET` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:05:46.474093 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1edbd9ca-acac-45df-b2bb-dbb1400bb7ad None admin] SCRIPT_NAME: `/identity` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:05:46.474417 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1edbd9ca-acac-45df-b2bb-dbb1400bb7ad None admin] PATH_INFO: `/v3/roles` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:05:46.475148 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1edbd9ca-acac-45df-b2bb-dbb1400bb7ad None admin] RBAC: Adding query filter params (name=admin) {{(pid=88550) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 19:05:46.475449 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1edbd9ca-acac-45df-b2bb-dbb1400bb7ad None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:05:46.476873 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1edbd9ca-acac-45df-b2bb-dbb1400bb7ad None admin] RBAC: Authorization granted {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:05:46.491038 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: [pid: 88550|app: 0|req: 132/259] 10.222.0.26 () {56 vars in 1099 bytes} [Wed Aug 17 19:05:46 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 19:05:46.496241 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fa63152-f12a-47f5-a07d-21477fbb16cc None admin] Authenticating user token {{(pid=88551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:05:46.614679 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1edbd9ca-acac-45df-b2bb-dbb1400bb7ad None admin] Authenticating user token {{(pid=88550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:05:46.656600 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fa63152-f12a-47f5-a07d-21477fbb16cc None admin] Validating token access rules against request {{(pid=88551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:05:46.660597 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG dbcounter [-] [88551] Writing DB stats keystone:SELECT=100 {{(pid=88551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:05:46.714215 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG dbcounter [-] [88550] Writing DB stats keystone:SELECT=100 {{(pid=88550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:05:46.739341 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65fc76f3-d5d5-43bf-80e5-d5fc39ac516f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '819d41a279e64291acc60de51e1530ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:05:46.739990 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65fc76f3-d5d5-43bf-80e5-d5fc39ac516f None admin] REQUEST_METHOD: `GET` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:05:46.740274 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65fc76f3-d5d5-43bf-80e5-d5fc39ac516f None admin] SCRIPT_NAME: `/identity` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:05:46.740550 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65fc76f3-d5d5-43bf-80e5-d5fc39ac516f None admin] PATH_INFO: `/v3/users/5fef04c5e3ba470cab48fee3dc0eb32a` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:05:46.742310 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65fc76f3-d5d5-43bf-80e5-d5fc39ac516f None admin] RBAC: Authorizing `identity:get_user(user_id=5fef04c5e3ba470cab48fee3dc0eb32a)` {{(pid=88551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:05:46.743944 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65fc76f3-d5d5-43bf-80e5-d5fc39ac516f None admin] RBAC: Authorization granted {{(pid=88551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:05:46.750131 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: [pid: 88551|app: 0|req: 128/260] 10.222.0.26 () {56 vars in 1177 bytes} [Wed Aug 17 19:05:46 2022] GET /identity/v3/users/5fef04c5e3ba470cab48fee3dc0eb32a => generated 283 bytes in 250 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 19:05:46.752931 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65fc76f3-d5d5-43bf-80e5-d5fc39ac516f None admin] Authenticating user token {{(pid=88551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:05:46.854568 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1edbd9ca-acac-45df-b2bb-dbb1400bb7ad None admin] Validating token access rules against request {{(pid=88550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:05:46.918422 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1c8a1fa-3222-4621-a7f1-305c39e3ebb9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '819d41a279e64291acc60de51e1530ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:05:46.919108 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c8a1fa-3222-4621-a7f1-305c39e3ebb9 None admin] REQUEST_METHOD: `GET` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:05:46.919397 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c8a1fa-3222-4621-a7f1-305c39e3ebb9 None admin] SCRIPT_NAME: `/identity` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:05:46.919675 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c8a1fa-3222-4621-a7f1-305c39e3ebb9 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:05:46.954731 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1c8a1fa-3222-4621-a7f1-305c39e3ebb9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 17 19:05:46.960240 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application [None req-e1c8a1fa-3222-4621-a7f1-305c39e3ebb9 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 17 19:05:46.960240 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 19:05:46.960240 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 19:05:46.960240 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 19:05:46.960240 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 19:05:46.960240 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 19:05:46.960240 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 19:05:46.960240 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 19:05:46.960240 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 19:05:46.960240 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 19:05:46.960240 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 19:05:46.960240 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 19:05:46.960240 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 17 19:05:46.960240 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 17 19:05:46.960240 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 17 19:05:46.960240 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 17 19:05:46.961137 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 17 19:05:46.961137 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 17 19:05:46.961137 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 17 19:05:46.961137 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 17 19:05:46.961137 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 19:05:46.961137 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 19:05:46.961137 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 19:05:46.961137 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 19:05:46.961137 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 19:05:46.961137 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 19:05:46.961137 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 19:05:46.961137 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application with Lock( Aug 17 19:05:46.961137 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 19:05:46.961137 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return self._enter() Aug 17 19:05:46.961137 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 19:05:46.961137 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 19:05:46.962123 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 19:05:46.962123 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return self.creator() Aug 17 19:05:46.962123 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 19:05:46.962123 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application created_value = creator( Aug 17 19:05:46.962123 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 17 19:05:46.962123 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 17 19:05:46.962123 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 17 19:05:46.962123 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 17 19:05:46.962123 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 17 19:05:46.962123 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 17 19:05:46.962123 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 17 19:05:46.962123 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application Aug 17 19:05:46.962123 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: [pid: 88550|app: 0|req: 133/261] 10.222.0.26 () {56 vars in 1114 bytes} [Wed Aug 17 19:05:46 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 347 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 19:05:46.967362 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1c8a1fa-3222-4621-a7f1-305c39e3ebb9 None admin] Authenticating user token {{(pid=88550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:05:47.034781 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65fc76f3-d5d5-43bf-80e5-d5fc39ac516f None admin] Validating token access rules against request {{(pid=88551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:05:47.132347 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75377ae0-11d3-47a1-a7d7-a692f3e4d61c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '819d41a279e64291acc60de51e1530ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:05:47.133016 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75377ae0-11d3-47a1-a7d7-a692f3e4d61c None admin] REQUEST_METHOD: `GET` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:05:47.133338 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75377ae0-11d3-47a1-a7d7-a692f3e4d61c None admin] SCRIPT_NAME: `/identity` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:05:47.133615 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75377ae0-11d3-47a1-a7d7-a692f3e4d61c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:05:47.196517 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG dbcounter [-] [88550] Writing DB stats keystone:SELECT=100 {{(pid=88550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:05:47.204583 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1c8a1fa-3222-4621-a7f1-305c39e3ebb9 None admin] Validating token access rules against request {{(pid=88550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:05:47.242892 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG dbcounter [-] [88551] Writing DB stats keystone:SELECT=100 {{(pid=88551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:05:47.276130 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-047b931c-edbd-4377-9cd1-3fadf2295b70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '819d41a279e64291acc60de51e1530ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:05:47.276752 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047b931c-edbd-4377-9cd1-3fadf2295b70 None admin] REQUEST_METHOD: `GET` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:05:47.277036 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047b931c-edbd-4377-9cd1-3fadf2295b70 None admin] SCRIPT_NAME: `/identity` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:05:47.277311 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047b931c-edbd-4377-9cd1-3fadf2295b70 None admin] PATH_INFO: `/v3/roles` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:05:47.277974 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-047b931c-edbd-4377-9cd1-3fadf2295b70 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=88550) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 19:05:47.278281 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-047b931c-edbd-4377-9cd1-3fadf2295b70 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:05:47.279842 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-047b931c-edbd-4377-9cd1-3fadf2295b70 None admin] RBAC: Authorization granted {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:05:47.300912 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: [pid: 88550|app: 0|req: 134/262] 10.222.0.26 () {56 vars in 1111 bytes} [Wed Aug 17 19:05:46 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 334 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 19:05:47.306630 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-047b931c-edbd-4377-9cd1-3fadf2295b70 None admin] Authenticating user token {{(pid=88550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:05:47.318861 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75377ae0-11d3-47a1-a7d7-a692f3e4d61c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:05:47.320368 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75377ae0-11d3-47a1-a7d7-a692f3e4d61c None admin] RBAC: Authorization granted {{(pid=88551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:05:47.503700 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-047b931c-edbd-4377-9cd1-3fadf2295b70 None admin] Validating token access rules against request {{(pid=88550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:05:47.548998 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b436f711-d912-42a6-bf0b-4e49193a819b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '819d41a279e64291acc60de51e1530ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:05:47.550045 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b436f711-d912-42a6-bf0b-4e49193a819b None admin] REQUEST_METHOD: `GET` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:05:47.550520 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b436f711-d912-42a6-bf0b-4e49193a819b None admin] SCRIPT_NAME: `/identity` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:05:47.551225 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b436f711-d912-42a6-bf0b-4e49193a819b None admin] PATH_INFO: `/v3/users/5fef04c5e3ba470cab48fee3dc0eb32a` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:05:47.552791 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b436f711-d912-42a6-bf0b-4e49193a819b None admin] RBAC: Authorizing `identity:get_user(user_id=5fef04c5e3ba470cab48fee3dc0eb32a)` {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:05:47.554514 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b436f711-d912-42a6-bf0b-4e49193a819b None admin] RBAC: Authorization granted {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:05:47.556982 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: [pid: 88550|app: 0|req: 135/263] 10.222.0.26 () {56 vars in 1177 bytes} [Wed Aug 17 19:05:47 2022] GET /identity/v3/users/5fef04c5e3ba470cab48fee3dc0eb32a => generated 283 bytes in 251 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 19:05:47.563204 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b436f711-d912-42a6-bf0b-4e49193a819b None admin] Authenticating user token {{(pid=88550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:05:47.596409 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG dbcounter [-] [88550] Writing DB stats keystone:SELECT=100 {{(pid=88550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:05:47.601553 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: [pid: 88551|app: 0|req: 129/264] 10.222.0.26 () {58 vars in 1282 bytes} [Wed Aug 17 19:05:46 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 849 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 17 19:05:47.607213 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75377ae0-11d3-47a1-a7d7-a692f3e4d61c None admin] Authenticating user token {{(pid=88551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:05:47.680431 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b436f711-d912-42a6-bf0b-4e49193a819b None admin] Validating token access rules against request {{(pid=88550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:05:47.721356 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b33f71a0-aa9f-4e93-8168-8e8bc15ff2bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '819d41a279e64291acc60de51e1530ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:05:47.722870 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b33f71a0-aa9f-4e93-8168-8e8bc15ff2bd None admin] REQUEST_METHOD: `GET` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:05:47.723351 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b33f71a0-aa9f-4e93-8168-8e8bc15ff2bd None admin] SCRIPT_NAME: `/identity` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:05:47.723794 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b33f71a0-aa9f-4e93-8168-8e8bc15ff2bd None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:05:47.746938 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG dbcounter [-] [88551] Writing DB stats keystone:SELECT=100 {{(pid=88551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:05:47.781061 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75377ae0-11d3-47a1-a7d7-a692f3e4d61c None admin] Validating token access rules against request {{(pid=88551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:05:47.799891 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b33f71a0-aa9f-4e93-8168-8e8bc15ff2bd None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:05:47.801699 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b33f71a0-aa9f-4e93-8168-8e8bc15ff2bd None admin] RBAC: Authorization granted {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:05:47.831167 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG dbcounter [-] [88550] Writing DB stats keystone:SELECT=100 {{(pid=88550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:05:47.847305 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1ddbcb0-10e5-4c85-8783-7e10dd404b03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '819d41a279e64291acc60de51e1530ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:05:47.847928 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ddbcb0-10e5-4c85-8783-7e10dd404b03 None admin] REQUEST_METHOD: `GET` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:05:47.848209 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ddbcb0-10e5-4c85-8783-7e10dd404b03 None admin] SCRIPT_NAME: `/identity` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:05:47.848486 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ddbcb0-10e5-4c85-8783-7e10dd404b03 None admin] PATH_INFO: `/v3/projects/4ebe56b7d67e4584afee4a218097f2b4` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:05:47.849725 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1ddbcb0-10e5-4c85-8783-7e10dd404b03 None admin] RBAC: Authorizing `identity:get_project(project_id=4ebe56b7d67e4584afee4a218097f2b4)` {{(pid=88551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:05:47.851224 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1ddbcb0-10e5-4c85-8783-7e10dd404b03 None admin] RBAC: Authorization granted {{(pid=88551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:05:47.853515 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: [pid: 88551|app: 0|req: 130/265] 10.222.0.26 () {56 vars in 1186 bytes} [Wed Aug 17 19:05:47 2022] GET /identity/v3/projects/4ebe56b7d67e4584afee4a218097f2b4 => generated 302 bytes in 247 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 19:05:47.860028 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1ddbcb0-10e5-4c85-8783-7e10dd404b03 None admin] Authenticating user token {{(pid=88551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:05:47.940304 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: [pid: 88550|app: 0|req: 136/266] 10.222.0.26 () {58 vars in 1282 bytes} [Wed Aug 17 19:05:47 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 377 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 17 19:05:47.946266 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b33f71a0-aa9f-4e93-8168-8e8bc15ff2bd None admin] Authenticating user token {{(pid=88550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:05:47.988964 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1ddbcb0-10e5-4c85-8783-7e10dd404b03 None admin] Validating token access rules against request {{(pid=88551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:05:48.035107 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42c74d23-838d-4522-813d-e47e7f2c5f2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '819d41a279e64291acc60de51e1530ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:05:48.035730 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c74d23-838d-4522-813d-e47e7f2c5f2b None admin] REQUEST_METHOD: `GET` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:05:48.036063 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c74d23-838d-4522-813d-e47e7f2c5f2b None admin] SCRIPT_NAME: `/identity` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:05:48.036344 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c74d23-838d-4522-813d-e47e7f2c5f2b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:05:48.037349 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42c74d23-838d-4522-813d-e47e7f2c5f2b None admin] RBAC: Adding query filter params (role.id=204f62ae18174b60a2e3f5d4f28ea326, scope.project.id=4ebe56b7d67e4584afee4a218097f2b4, user.id=5fef04c5e3ba470cab48fee3dc0eb32a) {{(pid=88551) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 19:05:48.037678 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42c74d23-838d-4522-813d-e47e7f2c5f2b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:05:48.040194 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42c74d23-838d-4522-813d-e47e7f2c5f2b None admin] RBAC: Authorization granted {{(pid=88551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:05:48.051944 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: [pid: 88551|app: 0|req: 131/267] 10.222.0.26 () {56 vars in 1374 bytes} [Wed Aug 17 19:05:47 2022] GET /identity/v3/role_assignments?user.id=5fef04c5e3ba470cab48fee3dc0eb32a&scope.project.id=4ebe56b7d67e4584afee4a218097f2b4&role.id=204f62ae18174b60a2e3f5d4f28ea326 => generated 608 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 17 19:05:48.116715 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b33f71a0-aa9f-4e93-8168-8e8bc15ff2bd None admin] Validating token access rules against request {{(pid=88550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:05:48.160014 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG dbcounter [-] [88550] Writing DB stats keystone:SELECT=100 {{(pid=88550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:05:48.175443 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0b3fbb3-733d-4aca-8752-0979d3efb0c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '819d41a279e64291acc60de51e1530ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:05:48.176470 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b3fbb3-733d-4aca-8752-0979d3efb0c9 None admin] REQUEST_METHOD: `GET` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:05:48.176965 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b3fbb3-733d-4aca-8752-0979d3efb0c9 None admin] SCRIPT_NAME: `/identity` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:05:48.177420 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b3fbb3-733d-4aca-8752-0979d3efb0c9 None admin] PATH_INFO: `/v3/projects/4ebe56b7d67e4584afee4a218097f2b4` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:05:48.183494 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0b3fbb3-733d-4aca-8752-0979d3efb0c9 None admin] RBAC: Authorizing `identity:get_project(project_id=4ebe56b7d67e4584afee4a218097f2b4)` {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:05:48.185655 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0b3fbb3-733d-4aca-8752-0979d3efb0c9 None admin] RBAC: Authorization granted {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:05:48.188212 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: [pid: 88550|app: 0|req: 137/268] 10.222.0.26 () {56 vars in 1186 bytes} [Wed Aug 17 19:05:47 2022] GET /identity/v3/projects/4ebe56b7d67e4584afee4a218097f2b4 => generated 302 bytes in 242 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 19:05:48.196926 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42c74d23-838d-4522-813d-e47e7f2c5f2b None admin] Authenticating user token {{(pid=88551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:05:48.202872 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG dbcounter [-] [88551] Writing DB stats keystone:SELECT=100 {{(pid=88551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:05:48.321231 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42c74d23-838d-4522-813d-e47e7f2c5f2b None admin] Validating token access rules against request {{(pid=88551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:05:48.357956 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f340335-265e-4922-9b37-75e3b89ac385 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '819d41a279e64291acc60de51e1530ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:05:48.358704 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f340335-265e-4922-9b37-75e3b89ac385 None admin] REQUEST_METHOD: `GET` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:05:48.358990 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f340335-265e-4922-9b37-75e3b89ac385 None admin] SCRIPT_NAME: `/identity` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:05:48.359264 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f340335-265e-4922-9b37-75e3b89ac385 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:05:48.360006 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f340335-265e-4922-9b37-75e3b89ac385 None admin] RBAC: Adding query filter params (role.id=60df6490940943d3b281ddaab1b0b9f7, scope.project.id=4ebe56b7d67e4584afee4a218097f2b4, user.id=5fef04c5e3ba470cab48fee3dc0eb32a) {{(pid=88551) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 19:05:48.360319 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f340335-265e-4922-9b37-75e3b89ac385 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:05:48.361814 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f340335-265e-4922-9b37-75e3b89ac385 None admin] RBAC: Authorization granted {{(pid=88551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:05:48.368836 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: [pid: 88551|app: 0|req: 132/269] 10.222.0.26 () {56 vars in 1374 bytes} [Wed Aug 17 19:05:48 2022] GET /identity/v3/role_assignments?user.id=5fef04c5e3ba470cab48fee3dc0eb32a&scope.project.id=4ebe56b7d67e4584afee4a218097f2b4&role.id=60df6490940943d3b281ddaab1b0b9f7 => generated 608 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 19:05:48.496274 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea3ae557-fa3d-41eb-be6e-ecbc868d5a9e None None] REQUEST_METHOD: `GET` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:05:48.496869 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea3ae557-fa3d-41eb-be6e-ecbc868d5a9e None None] SCRIPT_NAME: `/identity` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:05:48.497289 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea3ae557-fa3d-41eb-be6e-ecbc868d5a9e None None] PATH_INFO: `/` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:05:48.498937 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: [pid: 88550|app: 0|req: 138/270] 10.222.0.26 () {54 vars in 927 bytes} [Wed Aug 17 19:05:48 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 19:05:48.512865 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c074bbf3-7e59-47a0-a2b8-fa97a4ecc8ed None None] REQUEST_METHOD: `POST` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:05:48.513154 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c074bbf3-7e59-47a0-a2b8-fa97a4ecc8ed None None] SCRIPT_NAME: `/identity` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:05:48.513583 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c074bbf3-7e59-47a0-a2b8-fa97a4ecc8ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:05:48.547828 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.auth.core [None req-c074bbf3-7e59-47a0-a2b8-fa97a4ecc8ed None None] MFA Rules not processed for user `819d41a279e64291acc60de51e1530ae`. Rule list: `[]` (Enabled: `True`). {{(pid=88551) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 19:05:48.549158 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.common.fernet_utils [None req-c074bbf3-7e59-47a0-a2b8-fa97a4ecc8ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:05:48.637239 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG dbcounter [-] [88551] Writing DB stats keystone:SELECT=100 {{(pid=88551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:05:48.643199 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: [pid: 88551|app: 0|req: 133/271] 10.222.0.26 () {58 vars in 1024 bytes} [Wed Aug 17 19:05:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 17 19:05:48.796299 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b1dd938-36c2-4a79-b3df-1305d975f879 None None] REQUEST_METHOD: `GET` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:05:48.796827 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b1dd938-36c2-4a79-b3df-1305d975f879 None None] SCRIPT_NAME: `/identity` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:05:48.797037 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b1dd938-36c2-4a79-b3df-1305d975f879 None None] PATH_INFO: `/` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:05:48.799414 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: [pid: 88550|app: 0|req: 139/272] 10.222.0.26 () {54 vars in 927 bytes} [Wed Aug 17 19:05:48 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 19:05:48.806407 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6317877-05c9-48b6-968f-e88748b61cf5 None None] REQUEST_METHOD: `POST` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:05:48.806939 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6317877-05c9-48b6-968f-e88748b61cf5 None None] SCRIPT_NAME: `/identity` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:05:48.807147 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6317877-05c9-48b6-968f-e88748b61cf5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:05:48.827958 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.auth.core [None req-b6317877-05c9-48b6-968f-e88748b61cf5 None None] MFA Rules not processed for user `819d41a279e64291acc60de51e1530ae`. Rule list: `[]` (Enabled: `True`). {{(pid=88551) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 19:05:48.829163 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.common.fernet_utils [None req-b6317877-05c9-48b6-968f-e88748b61cf5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:05:48.908874 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: [pid: 88551|app: 0|req: 134/273] 10.222.0.26 () {58 vars in 1024 bytes} [Wed Aug 17 19:05:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 17 19:05:49.039958 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b1dd938-36c2-4a79-b3df-1305d975f879 None None] Authenticating user token {{(pid=88550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:05:49.156351 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b1dd938-36c2-4a79-b3df-1305d975f879 None None] Validating token access rules against request {{(pid=88550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:05:49.194004 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9af4d7e-7cb5-4ef0-a527-22424ad63c2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '819d41a279e64291acc60de51e1530ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:05:49.194642 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9af4d7e-7cb5-4ef0-a527-22424ad63c2f None admin] REQUEST_METHOD: `GET` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:05:49.194923 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9af4d7e-7cb5-4ef0-a527-22424ad63c2f None admin] SCRIPT_NAME: `/identity` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:05:49.195194 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9af4d7e-7cb5-4ef0-a527-22424ad63c2f None admin] PATH_INFO: `/v3/domains/default` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:05:49.196298 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9af4d7e-7cb5-4ef0-a527-22424ad63c2f None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:05:49.197867 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9af4d7e-7cb5-4ef0-a527-22424ad63c2f None admin] RBAC: Authorization granted {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:05:49.200031 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: [pid: 88550|app: 0|req: 140/274] 10.222.0.26 () {56 vars in 1108 bytes} [Wed Aug 17 19:05:49 2022] GET /identity/v3/domains/default => generated 199 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 19:05:49.206027 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6317877-05c9-48b6-968f-e88748b61cf5 None None] Authenticating user token {{(pid=88551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:05:49.311898 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f8a1615-81d1-4824-ac59-bac803f9ca09 None None] REQUEST_METHOD: `GET` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:05:49.312526 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f8a1615-81d1-4824-ac59-bac803f9ca09 None None] SCRIPT_NAME: `/identity` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:05:49.312957 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6317877-05c9-48b6-968f-e88748b61cf5 None None] Validating token access rules against request {{(pid=88551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:05:49.313220 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f8a1615-81d1-4824-ac59-bac803f9ca09 None None] PATH_INFO: `/` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:05:49.315219 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: [pid: 88550|app: 0|req: 141/275] 10.222.0.26 () {54 vars in 927 bytes} [Wed Aug 17 19:05:49 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 19:05:49.321054 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f8a1615-81d1-4824-ac59-bac803f9ca09 None None] Authenticating user token {{(pid=88550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:05:49.344553 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG dbcounter [-] [88551] Writing DB stats keystone:SELECT=100 {{(pid=88551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:05:49.353916 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62b7f28d-4246-49a9-8a47-b8ecec758c78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '819d41a279e64291acc60de51e1530ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:05:49.354677 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b7f28d-4246-49a9-8a47-b8ecec758c78 None admin] REQUEST_METHOD: `POST` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:05:49.354957 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b7f28d-4246-49a9-8a47-b8ecec758c78 None admin] SCRIPT_NAME: `/identity` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:05:49.355226 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b7f28d-4246-49a9-8a47-b8ecec758c78 None admin] PATH_INFO: `/v3/users` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:05:49.355878 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62b7f28d-4246-49a9-8a47-b8ecec758c78 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=88551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:05:49.357387 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62b7f28d-4246-49a9-8a47-b8ecec758c78 None admin] RBAC: Authorization granted {{(pid=88551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:05:49.390849 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG dbcounter [-] [88550] Writing DB stats keystone:SELECT=100 {{(pid=88550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:05:49.428510 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f8a1615-81d1-4824-ac59-bac803f9ca09 None None] Validating token access rules against request {{(pid=88550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:05:49.462285 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb2a7813-0a58-4c2d-a3f6-dd4712244599 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '819d41a279e64291acc60de51e1530ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:05:49.462891 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb2a7813-0a58-4c2d-a3f6-dd4712244599 None admin] REQUEST_METHOD: `GET` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:05:49.463170 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb2a7813-0a58-4c2d-a3f6-dd4712244599 None admin] SCRIPT_NAME: `/identity` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:05:49.463441 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb2a7813-0a58-4c2d-a3f6-dd4712244599 None admin] PATH_INFO: `/v3/roles/member` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:05:49.474656 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb2a7813-0a58-4c2d-a3f6-dd4712244599 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 17 19:05:49.479353 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application [None req-eb2a7813-0a58-4c2d-a3f6-dd4712244599 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 17 19:05:49.479353 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 19:05:49.479353 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 19:05:49.479353 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 19:05:49.479353 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 19:05:49.479353 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 19:05:49.479353 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 19:05:49.479353 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 19:05:49.479353 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 19:05:49.479353 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 19:05:49.479353 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 19:05:49.479353 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 19:05:49.479353 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 17 19:05:49.479353 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 17 19:05:49.479353 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 17 19:05:49.479353 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 17 19:05:49.480458 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 17 19:05:49.480458 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 17 19:05:49.480458 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 17 19:05:49.480458 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 17 19:05:49.480458 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 19:05:49.480458 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 19:05:49.480458 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 19:05:49.480458 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 19:05:49.480458 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 19:05:49.480458 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 19:05:49.480458 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 19:05:49.480458 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application with Lock( Aug 17 19:05:49.480458 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 19:05:49.480458 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return self._enter() Aug 17 19:05:49.480458 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 19:05:49.480458 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 19:05:49.481571 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 19:05:49.481571 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return self.creator() Aug 17 19:05:49.481571 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 19:05:49.481571 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application created_value = creator( Aug 17 19:05:49.481571 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 17 19:05:49.481571 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 17 19:05:49.481571 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 17 19:05:49.481571 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 17 19:05:49.481571 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 17 19:05:49.481571 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 17 19:05:49.481571 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 17 19:05:49.481571 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application Aug 17 19:05:49.485377 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: [pid: 88550|app: 0|req: 142/276] 10.222.0.26 () {56 vars in 1099 bytes} [Wed Aug 17 19:05:49 2022] GET /identity/v3/roles/member => generated 84 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 19:05:49.486402 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb9b4030-91e9-434a-8b98-3207219a2914 None None] REQUEST_METHOD: `POST` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:05:49.486714 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb9b4030-91e9-434a-8b98-3207219a2914 None None] SCRIPT_NAME: `/identity` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:05:49.486990 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb9b4030-91e9-434a-8b98-3207219a2914 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:05:49.503982 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.auth.core [None req-cb9b4030-91e9-434a-8b98-3207219a2914 None None] MFA Rules not processed for user `819d41a279e64291acc60de51e1530ae`. Rule list: `[]` (Enabled: `True`). {{(pid=88550) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 19:05:49.505163 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.common.fernet_utils [None req-cb9b4030-91e9-434a-8b98-3207219a2914 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:05:49.548633 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: [pid: 88551|app: 0|req: 135/277] 10.222.0.26 () {60 vars in 1132 bytes} [Wed Aug 17 19:05:49 2022] POST /identity/v3/users => generated 293 bytes in 343 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 19:05:49.549405 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62b7f28d-4246-49a9-8a47-b8ecec758c78 None admin] Authenticating user token {{(pid=88551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:05:49.573484 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: [pid: 88550|app: 0|req: 143/278] 10.222.0.26 () {58 vars in 1024 bytes} [Wed Aug 17 19:05:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 17 19:05:49.574826 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c8a78d2-5c31-4365-b455-fed2ded1e133 None None] REQUEST_METHOD: `GET` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:05:49.575126 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c8a78d2-5c31-4365-b455-fed2ded1e133 None None] SCRIPT_NAME: `/identity` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:05:49.575380 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c8a78d2-5c31-4365-b455-fed2ded1e133 None None] PATH_INFO: `/` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:05:49.576828 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: [pid: 88550|app: 0|req: 144/279] 10.222.0.26 () {54 vars in 927 bytes} [Wed Aug 17 19:05:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 19:05:49.583026 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a64bbc22-13cd-4d3d-912b-cd7910b5a548 None None] REQUEST_METHOD: `POST` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:05:49.583344 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a64bbc22-13cd-4d3d-912b-cd7910b5a548 None None] SCRIPT_NAME: `/identity` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:05:49.583553 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a64bbc22-13cd-4d3d-912b-cd7910b5a548 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:05:49.608773 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.auth.core [None req-a64bbc22-13cd-4d3d-912b-cd7910b5a548 None None] MFA Rules not processed for user `819d41a279e64291acc60de51e1530ae`. Rule list: `[]` (Enabled: `True`). {{(pid=88550) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 19:05:49.611449 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.common.fernet_utils [None req-a64bbc22-13cd-4d3d-912b-cd7910b5a548 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:05:49.686907 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG dbcounter [-] [88550] Writing DB stats keystone:SELECT=100 {{(pid=88550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:05:49.704208 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62b7f28d-4246-49a9-8a47-b8ecec758c78 None admin] Validating token access rules against request {{(pid=88551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:05:49.719027 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: [pid: 88550|app: 0|req: 145/280] 10.222.0.26 () {58 vars in 1024 bytes} [Wed Aug 17 19:05:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 17 19:05:49.756257 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf8bedd3-3196-4d6e-89ce-104a3c9ac1a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '819d41a279e64291acc60de51e1530ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:05:49.756889 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf8bedd3-3196-4d6e-89ce-104a3c9ac1a8 None admin] REQUEST_METHOD: `GET` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:05:49.757171 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf8bedd3-3196-4d6e-89ce-104a3c9ac1a8 None admin] SCRIPT_NAME: `/identity` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:05:49.757443 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf8bedd3-3196-4d6e-89ce-104a3c9ac1a8 None admin] PATH_INFO: `/v3/roles` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:05:49.758112 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf8bedd3-3196-4d6e-89ce-104a3c9ac1a8 None admin] RBAC: Adding query filter params (name=member) {{(pid=88551) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 19:05:49.758414 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf8bedd3-3196-4d6e-89ce-104a3c9ac1a8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:05:49.760196 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf8bedd3-3196-4d6e-89ce-104a3c9ac1a8 None admin] RBAC: Authorization granted {{(pid=88551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:05:49.771292 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: [pid: 88551|app: 0|req: 136/281] 10.222.0.26 () {56 vars in 1101 bytes} [Wed Aug 17 19:05:49 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 19:05:49.776593 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a64bbc22-13cd-4d3d-912b-cd7910b5a548 None None] Authenticating user token {{(pid=88550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:05:49.886855 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a64bbc22-13cd-4d3d-912b-cd7910b5a548 None None] Validating token access rules against request {{(pid=88550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:05:49.925412 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42a22cab-28ae-429e-8490-07eec16ad105 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '819d41a279e64291acc60de51e1530ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:05:49.926405 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a22cab-28ae-429e-8490-07eec16ad105 None admin] REQUEST_METHOD: `GET` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:05:49.926923 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a22cab-28ae-429e-8490-07eec16ad105 None admin] SCRIPT_NAME: `/identity` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:05:49.927424 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a22cab-28ae-429e-8490-07eec16ad105 None admin] PATH_INFO: `/v3/users/da7bffd2f6834519abd0642b11f19550` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:05:49.944146 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42a22cab-28ae-429e-8490-07eec16ad105 None admin] RBAC: Authorizing `identity:get_user(user_id=da7bffd2f6834519abd0642b11f19550)` {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:05:49.947014 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42a22cab-28ae-429e-8490-07eec16ad105 None admin] RBAC: Authorization granted {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:05:49.947907 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: [pid: 88550|app: 0|req: 146/282] 10.222.0.26 () {56 vars in 1177 bytes} [Wed Aug 17 19:05:49 2022] GET /identity/v3/users/da7bffd2f6834519abd0642b11f19550 => generated 293 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 19:05:49.949867 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf8bedd3-3196-4d6e-89ce-104a3c9ac1a8 None admin] Authenticating user token {{(pid=88551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:05:49.954017 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42a22cab-28ae-429e-8490-07eec16ad105 None admin] Authenticating user token {{(pid=88550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:05:50.015661 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG dbcounter [-] [88551] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:05:50.034463 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG dbcounter [-] [88550] Writing DB stats keystone:SELECT=100 {{(pid=88550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:05:50.080450 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf8bedd3-3196-4d6e-89ce-104a3c9ac1a8 None admin] Validating token access rules against request {{(pid=88551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:05:50.089710 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42a22cab-28ae-429e-8490-07eec16ad105 None admin] Validating token access rules against request {{(pid=88550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:05:50.122352 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dd24acb-8e2d-4a33-8f21-6dc8b74f765b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '819d41a279e64291acc60de51e1530ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:05:50.123028 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd24acb-8e2d-4a33-8f21-6dc8b74f765b None admin] REQUEST_METHOD: `GET` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:05:50.123307 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd24acb-8e2d-4a33-8f21-6dc8b74f765b None admin] SCRIPT_NAME: `/identity` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:05:50.123574 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd24acb-8e2d-4a33-8f21-6dc8b74f765b None admin] PATH_INFO: `/v3/roles/reader` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:05:50.134939 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dd24acb-8e2d-4a33-8f21-6dc8b74f765b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 17 19:05:50.140891 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application [None req-3dd24acb-8e2d-4a33-8f21-6dc8b74f765b None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 17 19:05:50.140891 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 19:05:50.140891 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 19:05:50.140891 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 19:05:50.140891 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 19:05:50.140891 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 19:05:50.140891 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 19:05:50.140891 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 19:05:50.140891 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 19:05:50.140891 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 19:05:50.140891 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 19:05:50.140891 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 19:05:50.140891 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 17 19:05:50.140891 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 17 19:05:50.140891 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 17 19:05:50.140891 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 17 19:05:50.146379 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 17 19:05:50.146379 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 17 19:05:50.146379 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 17 19:05:50.146379 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 17 19:05:50.146379 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 19:05:50.146379 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 19:05:50.146379 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 19:05:50.146379 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 19:05:50.146379 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 19:05:50.146379 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 19:05:50.146379 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 19:05:50.146379 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application with Lock( Aug 17 19:05:50.146379 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 19:05:50.146379 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application return self._enter() Aug 17 19:05:50.146379 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 19:05:50.146379 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 19:05:50.147223 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 19:05:50.147223 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application return self.creator() Aug 17 19:05:50.147223 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 19:05:50.147223 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application created_value = creator( Aug 17 19:05:50.147223 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 17 19:05:50.147223 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 17 19:05:50.147223 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 17 19:05:50.147223 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 17 19:05:50.147223 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 17 19:05:50.147223 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 17 19:05:50.147223 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 17 19:05:50.147223 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application Aug 17 19:05:50.147223 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: [pid: 88551|app: 0|req: 137/283] 10.222.0.26 () {56 vars in 1099 bytes} [Wed Aug 17 19:05:49 2022] GET /identity/v3/roles/reader => generated 84 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 19:05:50.147223 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dd24acb-8e2d-4a33-8f21-6dc8b74f765b None admin] Authenticating user token {{(pid=88551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:05:50.151320 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ce9647a-419b-479e-b65e-aba1e17bd012 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '819d41a279e64291acc60de51e1530ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:05:50.151946 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce9647a-419b-479e-b65e-aba1e17bd012 None admin] REQUEST_METHOD: `GET` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:05:50.152224 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce9647a-419b-479e-b65e-aba1e17bd012 None admin] SCRIPT_NAME: `/identity` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:05:50.152493 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce9647a-419b-479e-b65e-aba1e17bd012 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:05:50.153223 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ce9647a-419b-479e-b65e-aba1e17bd012 None admin] RBAC: Adding query filter params (role.id=748773430faa4030989e1e77b3f361e1, user.id=da7bffd2f6834519abd0642b11f19550, scope.system=all) {{(pid=88550) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 19:05:50.153526 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ce9647a-419b-479e-b65e-aba1e17bd012 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:05:50.155017 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ce9647a-419b-479e-b65e-aba1e17bd012 None admin] RBAC: Authorization granted {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:05:50.161246 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: [pid: 88550|app: 0|req: 147/284] 10.222.0.26 () {56 vars in 1308 bytes} [Wed Aug 17 19:05:49 2022] GET /identity/v3/role_assignments?user.id=da7bffd2f6834519abd0642b11f19550&scope.system=all&role.id=748773430faa4030989e1e77b3f361e1 => generated 226 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 17 19:05:50.162069 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ce9647a-419b-479e-b65e-aba1e17bd012 None admin] Authenticating user token {{(pid=88550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:05:50.346517 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dd24acb-8e2d-4a33-8f21-6dc8b74f765b None admin] Validating token access rules against request {{(pid=88551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:05:50.360620 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG dbcounter [-] [88551] Writing DB stats keystone:SELECT=100 {{(pid=88551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:05:50.396218 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ce9647a-419b-479e-b65e-aba1e17bd012 None admin] Validating token access rules against request {{(pid=88550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:05:50.397570 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-013b25d1-6a93-482c-85cf-3b305561e2ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '819d41a279e64291acc60de51e1530ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:05:50.398525 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-013b25d1-6a93-482c-85cf-3b305561e2ec None admin] REQUEST_METHOD: `GET` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:05:50.398899 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-013b25d1-6a93-482c-85cf-3b305561e2ec None admin] SCRIPT_NAME: `/identity` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:05:50.399176 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-013b25d1-6a93-482c-85cf-3b305561e2ec None admin] PATH_INFO: `/v3/roles/member` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:05:50.406751 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG dbcounter [-] [88550] Writing DB stats keystone:SELECT=100 {{(pid=88550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:05:50.426355 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-013b25d1-6a93-482c-85cf-3b305561e2ec None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 17 19:05:50.439358 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application [None req-013b25d1-6a93-482c-85cf-3b305561e2ec None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 17 19:05:50.439358 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 19:05:50.439358 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 19:05:50.439358 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 19:05:50.439358 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 19:05:50.439358 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 19:05:50.439358 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 19:05:50.439358 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 19:05:50.439358 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 19:05:50.439358 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 19:05:50.439358 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 19:05:50.439358 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 19:05:50.439358 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 17 19:05:50.439358 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 17 19:05:50.439358 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 17 19:05:50.439358 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 17 19:05:50.440306 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 17 19:05:50.440306 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 17 19:05:50.440306 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 17 19:05:50.440306 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 17 19:05:50.440306 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 19:05:50.440306 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 19:05:50.440306 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 19:05:50.440306 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 19:05:50.440306 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 19:05:50.440306 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 19:05:50.440306 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 19:05:50.440306 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application with Lock( Aug 17 19:05:50.440306 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 19:05:50.440306 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application return self._enter() Aug 17 19:05:50.440306 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 19:05:50.440306 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 19:05:50.441095 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 19:05:50.441095 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application return self.creator() Aug 17 19:05:50.441095 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 19:05:50.441095 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application created_value = creator( Aug 17 19:05:50.441095 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 17 19:05:50.441095 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 17 19:05:50.441095 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 17 19:05:50.441095 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 17 19:05:50.441095 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 17 19:05:50.441095 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 17 19:05:50.441095 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 17 19:05:50.441095 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application Aug 17 19:05:50.441095 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: [pid: 88551|app: 0|req: 138/285] 10.222.0.26 () {56 vars in 1099 bytes} [Wed Aug 17 19:05:50 2022] GET /identity/v3/roles/member => generated 84 bytes in 298 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 19:05:50.457589 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-013b25d1-6a93-482c-85cf-3b305561e2ec None admin] Authenticating user token {{(pid=88551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:05:50.475216 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a528daac-fe30-4641-93e6-5c489e5d2e83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '819d41a279e64291acc60de51e1530ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:05:50.475840 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a528daac-fe30-4641-93e6-5c489e5d2e83 None admin] REQUEST_METHOD: `GET` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:05:50.476180 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a528daac-fe30-4641-93e6-5c489e5d2e83 None admin] SCRIPT_NAME: `/identity` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:05:50.476458 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a528daac-fe30-4641-93e6-5c489e5d2e83 None admin] PATH_INFO: `/v3/roles` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:05:50.477128 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a528daac-fe30-4641-93e6-5c489e5d2e83 None admin] RBAC: Adding query filter params (name=reader) {{(pid=88550) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 19:05:50.483545 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a528daac-fe30-4641-93e6-5c489e5d2e83 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:05:50.483545 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a528daac-fe30-4641-93e6-5c489e5d2e83 None admin] RBAC: Authorization granted {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:05:50.497094 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: [pid: 88550|app: 0|req: 148/286] 10.222.0.26 () {56 vars in 1101 bytes} [Wed Aug 17 19:05:50 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 335 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 19:05:50.504311 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a528daac-fe30-4641-93e6-5c489e5d2e83 None admin] Authenticating user token {{(pid=88550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:05:50.679015 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a528daac-fe30-4641-93e6-5c489e5d2e83 None admin] Validating token access rules against request {{(pid=88550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:05:50.716016 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff56c6e9-e264-40a3-bf1b-ef5248851c6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '819d41a279e64291acc60de51e1530ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:05:50.716712 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff56c6e9-e264-40a3-bf1b-ef5248851c6b None admin] REQUEST_METHOD: `GET` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:05:50.717000 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff56c6e9-e264-40a3-bf1b-ef5248851c6b None admin] SCRIPT_NAME: `/identity` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:05:50.717274 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff56c6e9-e264-40a3-bf1b-ef5248851c6b None admin] PATH_INFO: `/v3/users/d3148b713c4c4b3b97030eea9ae825d9` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:05:50.719144 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff56c6e9-e264-40a3-bf1b-ef5248851c6b None admin] RBAC: Authorizing `identity:get_user(user_id=d3148b713c4c4b3b97030eea9ae825d9)` {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:05:50.721083 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff56c6e9-e264-40a3-bf1b-ef5248851c6b None admin] RBAC: Authorization granted {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:05:50.721778 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-013b25d1-6a93-482c-85cf-3b305561e2ec None admin] Validating token access rules against request {{(pid=88551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:05:50.723097 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: [pid: 88550|app: 0|req: 149/287] 10.222.0.26 () {56 vars in 1177 bytes} [Wed Aug 17 19:05:50 2022] GET /identity/v3/users/d3148b713c4c4b3b97030eea9ae825d9 => generated 297 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 19:05:50.731588 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff56c6e9-e264-40a3-bf1b-ef5248851c6b None admin] Authenticating user token {{(pid=88550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:05:50.782563 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG dbcounter [-] [88550] Writing DB stats keystone:SELECT=100 {{(pid=88550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:05:50.784894 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6499a1d-b3f1-4510-88ca-2f48ed077560 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '819d41a279e64291acc60de51e1530ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:05:50.785521 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6499a1d-b3f1-4510-88ca-2f48ed077560 None admin] REQUEST_METHOD: `GET` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:05:50.785807 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6499a1d-b3f1-4510-88ca-2f48ed077560 None admin] SCRIPT_NAME: `/identity` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:05:50.788672 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6499a1d-b3f1-4510-88ca-2f48ed077560 None admin] PATH_INFO: `/v3/roles` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:05:50.789438 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6499a1d-b3f1-4510-88ca-2f48ed077560 None admin] RBAC: Adding query filter params (name=member) {{(pid=88551) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 19:05:50.809955 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6499a1d-b3f1-4510-88ca-2f48ed077560 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:05:50.809955 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6499a1d-b3f1-4510-88ca-2f48ed077560 None admin] RBAC: Authorization granted {{(pid=88551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:05:50.810940 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: [pid: 88551|app: 0|req: 139/288] 10.222.0.26 () {56 vars in 1101 bytes} [Wed Aug 17 19:05:50 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 354 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 17 19:05:50.824742 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6499a1d-b3f1-4510-88ca-2f48ed077560 None admin] Authenticating user token {{(pid=88551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:05:50.880936 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff56c6e9-e264-40a3-bf1b-ef5248851c6b None admin] Validating token access rules against request {{(pid=88550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:05:50.888347 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG dbcounter [-] [88551] Writing DB stats keystone:SELECT=100 {{(pid=88551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:05:50.935226 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-168e2c07-7868-46cf-9970-beec99d7147a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '819d41a279e64291acc60de51e1530ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:05:50.935898 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-168e2c07-7868-46cf-9970-beec99d7147a None admin] REQUEST_METHOD: `GET` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:05:50.936159 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-168e2c07-7868-46cf-9970-beec99d7147a None admin] SCRIPT_NAME: `/identity` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:05:50.936593 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-168e2c07-7868-46cf-9970-beec99d7147a None admin] PATH_INFO: `/v3/projects/4ebe56b7d67e4584afee4a218097f2b4` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:05:50.937792 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-168e2c07-7868-46cf-9970-beec99d7147a None admin] RBAC: Authorizing `identity:get_project(project_id=4ebe56b7d67e4584afee4a218097f2b4)` {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:05:50.939472 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-168e2c07-7868-46cf-9970-beec99d7147a None admin] RBAC: Authorization granted {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:05:50.941325 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: [pid: 88550|app: 0|req: 150/289] 10.222.0.26 () {56 vars in 1186 bytes} [Wed Aug 17 19:05:50 2022] GET /identity/v3/projects/4ebe56b7d67e4584afee4a218097f2b4 => generated 302 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 19:05:50.960426 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-168e2c07-7868-46cf-9970-beec99d7147a None admin] Authenticating user token {{(pid=88550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:05:50.997359 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6499a1d-b3f1-4510-88ca-2f48ed077560 None admin] Validating token access rules against request {{(pid=88551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:05:51.039552 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08e854ec-b7d0-41e7-9a82-ca35df3e38d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '819d41a279e64291acc60de51e1530ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:05:51.040213 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e854ec-b7d0-41e7-9a82-ca35df3e38d3 None admin] REQUEST_METHOD: `GET` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:05:51.040492 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e854ec-b7d0-41e7-9a82-ca35df3e38d3 None admin] SCRIPT_NAME: `/identity` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:05:51.040760 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e854ec-b7d0-41e7-9a82-ca35df3e38d3 None admin] PATH_INFO: `/v3/users/16b1dde65f2748e8934aa5345f0e5bb8` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:05:51.041947 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08e854ec-b7d0-41e7-9a82-ca35df3e38d3 None admin] RBAC: Authorizing `identity:get_user(user_id=16b1dde65f2748e8934aa5345f0e5bb8)` {{(pid=88551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:05:51.043429 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08e854ec-b7d0-41e7-9a82-ca35df3e38d3 None admin] RBAC: Authorization granted {{(pid=88551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:05:51.049248 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: [pid: 88551|app: 0|req: 140/290] 10.222.0.26 () {56 vars in 1177 bytes} [Wed Aug 17 19:05:50 2022] GET /identity/v3/users/16b1dde65f2748e8934aa5345f0e5bb8 => generated 297 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 17 19:05:51.054474 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08e854ec-b7d0-41e7-9a82-ca35df3e38d3 None admin] Authenticating user token {{(pid=88551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:05:51.170040 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08e854ec-b7d0-41e7-9a82-ca35df3e38d3 None admin] Validating token access rules against request {{(pid=88551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:05:51.206365 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67d9ddd1-5181-42e3-b799-e12e1062dd96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '819d41a279e64291acc60de51e1530ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:05:51.206926 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d9ddd1-5181-42e3-b799-e12e1062dd96 None admin] REQUEST_METHOD: `GET` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:05:51.207201 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d9ddd1-5181-42e3-b799-e12e1062dd96 None admin] SCRIPT_NAME: `/identity` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:05:51.207471 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d9ddd1-5181-42e3-b799-e12e1062dd96 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:05:51.211555 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG dbcounter [-] [88551] Writing DB stats keystone:SELECT=100 {{(pid=88551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:05:51.228427 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-168e2c07-7868-46cf-9970-beec99d7147a None admin] Validating token access rules against request {{(pid=88550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:05:51.234267 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG dbcounter [-] [88550] Writing DB stats keystone:SELECT=100 {{(pid=88550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:05:51.271828 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf2d23e0-facf-4575-8714-3521ca61397a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '819d41a279e64291acc60de51e1530ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:05:51.272665 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf2d23e0-facf-4575-8714-3521ca61397a None admin] REQUEST_METHOD: `PUT` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:05:51.272945 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf2d23e0-facf-4575-8714-3521ca61397a None admin] SCRIPT_NAME: `/identity` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:05:51.273280 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf2d23e0-facf-4575-8714-3521ca61397a None admin] PATH_INFO: `/v3/projects/4ebe56b7d67e4584afee4a218097f2b4/users/d3148b713c4c4b3b97030eea9ae825d9/roles/e46917e94e2e4018b346d95b26d804eb` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:05:51.275367 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf2d23e0-facf-4575-8714-3521ca61397a None admin] RBAC: Authorizing `identity:create_grant(project_id=4ebe56b7d67e4584afee4a218097f2b4, user_id=d3148b713c4c4b3b97030eea9ae825d9, role_id=e46917e94e2e4018b346d95b26d804eb)` {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:05:51.276961 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf2d23e0-facf-4575-8714-3521ca61397a None admin] RBAC: Authorization granted {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:05:51.290251 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67d9ddd1-5181-42e3-b799-e12e1062dd96 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:05:51.295343 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67d9ddd1-5181-42e3-b799-e12e1062dd96 None admin] RBAC: Authorization granted {{(pid=88551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:05:51.354107 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: [pid: 88550|app: 0|req: 151/291] 10.222.0.26 () {58 vars in 1439 bytes} [Wed Aug 17 19:05:50 2022] PUT /identity/v3/projects/4ebe56b7d67e4584afee4a218097f2b4/users/d3148b713c4c4b3b97030eea9ae825d9/roles/e46917e94e2e4018b346d95b26d804eb => generated 0 bytes in 403 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 19:05:51.409138 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG dbcounter [-] [88551] Writing DB stats keystone:SELECT=100 {{(pid=88551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:05:51.418719 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: [pid: 88551|app: 0|req: 141/292] 10.222.0.26 () {58 vars in 1282 bytes} [Wed Aug 17 19:05:51 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 365 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 17 19:05:51.421785 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf2d23e0-facf-4575-8714-3521ca61397a None admin] Authenticating user token {{(pid=88550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:05:51.538221 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf2d23e0-facf-4575-8714-3521ca61397a None admin] Validating token access rules against request {{(pid=88550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:05:51.586105 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99da0e8e-b30d-416f-84eb-ed5547d592e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '819d41a279e64291acc60de51e1530ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:05:51.587030 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99da0e8e-b30d-416f-84eb-ed5547d592e7 None admin] REQUEST_METHOD: `GET` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:05:51.587665 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99da0e8e-b30d-416f-84eb-ed5547d592e7 None admin] SCRIPT_NAME: `/identity` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:05:51.588081 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99da0e8e-b30d-416f-84eb-ed5547d592e7 None admin] PATH_INFO: `/v3/projects/4ebe56b7d67e4584afee4a218097f2b4` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:05:51.589496 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99da0e8e-b30d-416f-84eb-ed5547d592e7 None admin] RBAC: Authorizing `identity:get_project(project_id=4ebe56b7d67e4584afee4a218097f2b4)` {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:05:51.591201 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99da0e8e-b30d-416f-84eb-ed5547d592e7 None admin] RBAC: Authorization granted {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:05:51.593671 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: [pid: 88550|app: 0|req: 152/293] 10.222.0.26 () {56 vars in 1186 bytes} [Wed Aug 17 19:05:51 2022] GET /identity/v3/projects/4ebe56b7d67e4584afee4a218097f2b4 => generated 302 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 19:05:51.599669 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67d9ddd1-5181-42e3-b799-e12e1062dd96 None admin] Authenticating user token {{(pid=88551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:05:51.731141 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67d9ddd1-5181-42e3-b799-e12e1062dd96 None admin] Validating token access rules against request {{(pid=88551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:05:51.769035 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03ca38ac-f961-46a3-90d8-17f132c86986 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '819d41a279e64291acc60de51e1530ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:05:51.769641 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ca38ac-f961-46a3-90d8-17f132c86986 None admin] REQUEST_METHOD: `GET` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:05:51.769917 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ca38ac-f961-46a3-90d8-17f132c86986 None admin] SCRIPT_NAME: `/identity` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:05:51.770186 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ca38ac-f961-46a3-90d8-17f132c86986 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:05:51.770947 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03ca38ac-f961-46a3-90d8-17f132c86986 None admin] RBAC: Adding query filter params (role.id=748773430faa4030989e1e77b3f361e1, scope.project.id=4ebe56b7d67e4584afee4a218097f2b4, user.id=16b1dde65f2748e8934aa5345f0e5bb8) {{(pid=88551) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 19:05:51.771253 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03ca38ac-f961-46a3-90d8-17f132c86986 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:05:51.772725 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03ca38ac-f961-46a3-90d8-17f132c86986 None admin] RBAC: Authorization granted {{(pid=88551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:05:51.779876 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: [pid: 88551|app: 0|req: 142/294] 10.222.0.26 () {56 vars in 1374 bytes} [Wed Aug 17 19:05:51 2022] GET /identity/v3/role_assignments?user.id=16b1dde65f2748e8934aa5345f0e5bb8&scope.project.id=4ebe56b7d67e4584afee4a218097f2b4&role.id=748773430faa4030989e1e77b3f361e1 => generated 608 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 19:05:52.430526 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c91fdfee-2ad3-4694-8999-0ae9d578ec8b None None] REQUEST_METHOD: `GET` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:05:52.431663 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c91fdfee-2ad3-4694-8999-0ae9d578ec8b None None] SCRIPT_NAME: `/identity` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:05:52.432245 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c91fdfee-2ad3-4694-8999-0ae9d578ec8b None None] PATH_INFO: `/` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:05:52.433841 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: [pid: 88550|app: 0|req: 153/295] 10.222.0.26 () {54 vars in 927 bytes} [Wed Aug 17 19:05:52 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 19:05:52.440339 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7177be75-5a96-461b-8a26-242e110ba739 None None] REQUEST_METHOD: `POST` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:05:52.441193 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7177be75-5a96-461b-8a26-242e110ba739 None None] SCRIPT_NAME: `/identity` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:05:52.441661 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7177be75-5a96-461b-8a26-242e110ba739 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:05:52.461974 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.auth.core [None req-7177be75-5a96-461b-8a26-242e110ba739 None None] MFA Rules not processed for user `819d41a279e64291acc60de51e1530ae`. Rule list: `[]` (Enabled: `True`). {{(pid=88551) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 19:05:52.463525 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.common.fernet_utils [None req-7177be75-5a96-461b-8a26-242e110ba739 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:05:52.523986 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG dbcounter [-] [88551] Writing DB stats keystone:SELECT=100 {{(pid=88551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:05:52.538945 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-501360a9-2297-46f1-b09b-8a09909a8bdf None None] REQUEST_METHOD: `GET` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:05:52.539516 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-501360a9-2297-46f1-b09b-8a09909a8bdf None None] SCRIPT_NAME: `/identity` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:05:52.539830 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-501360a9-2297-46f1-b09b-8a09909a8bdf None None] PATH_INFO: `/` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:05:52.540237 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: [pid: 88551|app: 0|req: 143/296] 10.222.0.26 () {58 vars in 1024 bytes} [Wed Aug 17 19:05:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 17 19:05:52.541204 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: [pid: 88550|app: 0|req: 154/297] 10.222.0.26 () {54 vars in 927 bytes} [Wed Aug 17 19:05:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 17 19:05:52.546911 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1909298a-7a3d-4cd5-9877-60bed95b99e3 None None] REQUEST_METHOD: `POST` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:05:52.547198 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1909298a-7a3d-4cd5-9877-60bed95b99e3 None None] SCRIPT_NAME: `/identity` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:05:52.547477 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1909298a-7a3d-4cd5-9877-60bed95b99e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:05:52.566837 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.auth.core [None req-1909298a-7a3d-4cd5-9877-60bed95b99e3 None None] MFA Rules not processed for user `819d41a279e64291acc60de51e1530ae`. Rule list: `[]` (Enabled: `True`). {{(pid=88551) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 19:05:52.568042 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.common.fernet_utils [None req-1909298a-7a3d-4cd5-9877-60bed95b99e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:05:52.641307 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: [pid: 88551|app: 0|req: 144/298] 10.222.0.26 () {58 vars in 1024 bytes} [Wed Aug 17 19:05:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 17 19:05:52.907669 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-501360a9-2297-46f1-b09b-8a09909a8bdf None None] Authenticating user token {{(pid=88550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:05:52.946855 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG dbcounter [-] [88550] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:05:52.970144 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1909298a-7a3d-4cd5-9877-60bed95b99e3 None None] Authenticating user token {{(pid=88551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:05:53.030324 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-501360a9-2297-46f1-b09b-8a09909a8bdf None None] Validating token access rules against request {{(pid=88550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:05:53.068498 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-124a3bc5-5021-4523-ab5e-9fdeb7c94934 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '819d41a279e64291acc60de51e1530ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:05:53.069417 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-124a3bc5-5021-4523-ab5e-9fdeb7c94934 None admin] REQUEST_METHOD: `GET` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:05:53.069690 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-124a3bc5-5021-4523-ab5e-9fdeb7c94934 None admin] SCRIPT_NAME: `/identity` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:05:53.069958 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-124a3bc5-5021-4523-ab5e-9fdeb7c94934 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:05:53.081642 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-124a3bc5-5021-4523-ab5e-9fdeb7c94934 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 17 19:05:53.085812 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1909298a-7a3d-4cd5-9877-60bed95b99e3 None None] Validating token access rules against request {{(pid=88551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:05:53.088060 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application [None req-124a3bc5-5021-4523-ab5e-9fdeb7c94934 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 17 19:05:53.088060 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 19:05:53.088060 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 19:05:53.088060 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 19:05:53.088060 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 19:05:53.088060 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 19:05:53.088060 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 19:05:53.088060 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 19:05:53.088060 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 19:05:53.088060 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 19:05:53.088060 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 19:05:53.088060 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 19:05:53.088060 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 17 19:05:53.088060 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 17 19:05:53.088060 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 17 19:05:53.088060 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 17 19:05:53.088965 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 17 19:05:53.088965 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 17 19:05:53.088965 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 17 19:05:53.088965 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 17 19:05:53.088965 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 19:05:53.088965 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 19:05:53.088965 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 19:05:53.088965 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 19:05:53.088965 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 19:05:53.088965 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 19:05:53.088965 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 19:05:53.088965 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application with Lock( Aug 17 19:05:53.088965 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 19:05:53.088965 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return self._enter() Aug 17 19:05:53.088965 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 19:05:53.088965 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 19:05:53.089772 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 19:05:53.089772 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return self.creator() Aug 17 19:05:53.089772 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 19:05:53.089772 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application created_value = creator( Aug 17 19:05:53.089772 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 17 19:05:53.089772 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 17 19:05:53.089772 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 17 19:05:53.089772 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 17 19:05:53.089772 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 17 19:05:53.089772 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 17 19:05:53.089772 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 17 19:05:53.089772 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application Aug 17 19:05:53.089772 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: [pid: 88550|app: 0|req: 155/299] 10.222.0.26 () {56 vars in 1099 bytes} [Wed Aug 17 19:05:52 2022] GET /identity/v3/roles/reader => generated 84 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 19:05:53.095603 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae08e481-2470-4524-aa6d-f7d00765a7e6 None None] REQUEST_METHOD: `GET` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:05:53.095940 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae08e481-2470-4524-aa6d-f7d00765a7e6 None None] SCRIPT_NAME: `/identity` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:05:53.096211 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae08e481-2470-4524-aa6d-f7d00765a7e6 None None] PATH_INFO: `/` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:05:53.097513 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: [pid: 88550|app: 0|req: 156/300] 10.222.0.26 () {54 vars in 927 bytes} [Wed Aug 17 19:05:53 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 19:05:53.098271 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae08e481-2470-4524-aa6d-f7d00765a7e6 None None] Authenticating user token {{(pid=88550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:05:53.116027 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG dbcounter [-] [88551] Writing DB stats keystone:SELECT=100 {{(pid=88551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:05:53.133135 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d435d6b4-ce64-4f66-b4b6-bf1055726f99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '819d41a279e64291acc60de51e1530ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:05:53.133826 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d435d6b4-ce64-4f66-b4b6-bf1055726f99 None admin] REQUEST_METHOD: `GET` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:05:53.134104 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d435d6b4-ce64-4f66-b4b6-bf1055726f99 None admin] SCRIPT_NAME: `/identity` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:05:53.134376 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d435d6b4-ce64-4f66-b4b6-bf1055726f99 None admin] PATH_INFO: `/v3/domains/default` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:05:53.135512 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d435d6b4-ce64-4f66-b4b6-bf1055726f99 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=88551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:05:53.136947 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d435d6b4-ce64-4f66-b4b6-bf1055726f99 None admin] RBAC: Authorization granted {{(pid=88551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:05:53.138582 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: [pid: 88551|app: 0|req: 145/301] 10.222.0.26 () {56 vars in 1108 bytes} [Wed Aug 17 19:05:52 2022] GET /identity/v3/domains/default => generated 199 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 19:05:53.140388 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f1f878-8a6c-4409-a933-c0ed90d6dcf5 None None] REQUEST_METHOD: `POST` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:05:53.140952 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f1f878-8a6c-4409-a933-c0ed90d6dcf5 None None] SCRIPT_NAME: `/identity` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:05:53.141400 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f1f878-8a6c-4409-a933-c0ed90d6dcf5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:05:53.161059 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.auth.core [None req-b8f1f878-8a6c-4409-a933-c0ed90d6dcf5 None None] MFA Rules not processed for user `819d41a279e64291acc60de51e1530ae`. Rule list: `[]` (Enabled: `True`). {{(pid=88551) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 19:05:53.162185 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.common.fernet_utils [None req-b8f1f878-8a6c-4409-a933-c0ed90d6dcf5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:05:53.207863 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG dbcounter [-] [88550] Writing DB stats keystone:SELECT=100 {{(pid=88550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:05:53.217480 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae08e481-2470-4524-aa6d-f7d00765a7e6 None None] Validating token access rules against request {{(pid=88550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:05:53.247994 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: [pid: 88551|app: 0|req: 146/302] 10.222.0.26 () {58 vars in 1024 bytes} [Wed Aug 17 19:05:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 17 19:05:53.247994 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8f1f878-8a6c-4409-a933-c0ed90d6dcf5 None None] Authenticating user token {{(pid=88551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:05:53.267249 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-030a9862-52c9-4646-9dc9-6e1bd091595c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '819d41a279e64291acc60de51e1530ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:05:53.267910 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-030a9862-52c9-4646-9dc9-6e1bd091595c None admin] REQUEST_METHOD: `GET` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:05:53.268189 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-030a9862-52c9-4646-9dc9-6e1bd091595c None admin] SCRIPT_NAME: `/identity` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:05:53.268460 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-030a9862-52c9-4646-9dc9-6e1bd091595c None admin] PATH_INFO: `/v3/roles` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:05:53.269127 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-030a9862-52c9-4646-9dc9-6e1bd091595c None admin] RBAC: Adding query filter params (name=reader) {{(pid=88550) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 19:05:53.269473 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-030a9862-52c9-4646-9dc9-6e1bd091595c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:05:53.271217 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-030a9862-52c9-4646-9dc9-6e1bd091595c None admin] RBAC: Authorization granted {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:05:53.280632 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: [pid: 88550|app: 0|req: 157/303] 10.222.0.26 () {56 vars in 1101 bytes} [Wed Aug 17 19:05:53 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 19:05:53.286957 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-030a9862-52c9-4646-9dc9-6e1bd091595c None admin] Authenticating user token {{(pid=88550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:05:53.391938 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8f1f878-8a6c-4409-a933-c0ed90d6dcf5 None None] Validating token access rules against request {{(pid=88551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:05:53.410995 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-030a9862-52c9-4646-9dc9-6e1bd091595c None admin] Validating token access rules against request {{(pid=88550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:05:53.419128 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG dbcounter [-] [88551] Writing DB stats keystone:SELECT=100 {{(pid=88551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:05:53.443982 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec376bb9-054f-4ed1-825e-d9d2a1e43262 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '819d41a279e64291acc60de51e1530ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:05:53.445033 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec376bb9-054f-4ed1-825e-d9d2a1e43262 None admin] REQUEST_METHOD: `POST` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:05:53.445033 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec376bb9-054f-4ed1-825e-d9d2a1e43262 None admin] SCRIPT_NAME: `/identity` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:05:53.445462 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec376bb9-054f-4ed1-825e-d9d2a1e43262 None admin] PATH_INFO: `/v3/groups` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:05:53.446186 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec376bb9-054f-4ed1-825e-d9d2a1e43262 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=88551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:05:53.447983 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec376bb9-054f-4ed1-825e-d9d2a1e43262 None admin] RBAC: Authorization granted {{(pid=88551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:05:53.463529 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baecd25d-76f9-4345-a6ed-49664ac7afb6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '819d41a279e64291acc60de51e1530ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:05:53.464187 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baecd25d-76f9-4345-a6ed-49664ac7afb6 None admin] REQUEST_METHOD: `GET` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:05:53.464455 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baecd25d-76f9-4345-a6ed-49664ac7afb6 None admin] SCRIPT_NAME: `/identity` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:05:53.464730 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baecd25d-76f9-4345-a6ed-49664ac7afb6 None admin] PATH_INFO: `/v3/users/d3c3cbc565214959bfce57d44a8dc244` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:05:53.487308 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baecd25d-76f9-4345-a6ed-49664ac7afb6 None admin] RBAC: Authorizing `identity:get_user(user_id=d3c3cbc565214959bfce57d44a8dc244)` {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:05:53.488896 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baecd25d-76f9-4345-a6ed-49664ac7afb6 None admin] RBAC: Authorization granted {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:05:53.490802 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: [pid: 88550|app: 0|req: 158/304] 10.222.0.26 () {56 vars in 1177 bytes} [Wed Aug 17 19:05:53 2022] GET /identity/v3/users/d3c3cbc565214959bfce57d44a8dc244 => generated 293 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 19:05:53.496768 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baecd25d-76f9-4345-a6ed-49664ac7afb6 None admin] Authenticating user token {{(pid=88550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:05:53.512954 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG dbcounter [-] [88550] Writing DB stats keystone:SELECT=100 {{(pid=88550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:05:53.531337 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: [pid: 88551|app: 0|req: 147/305] 10.222.0.26 () {60 vars in 1134 bytes} [Wed Aug 17 19:05:53 2022] POST /identity/v3/groups => generated 229 bytes in 275 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 19:05:53.615783 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec376bb9-054f-4ed1-825e-d9d2a1e43262 None admin] Authenticating user token {{(pid=88551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:05:53.626238 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baecd25d-76f9-4345-a6ed-49664ac7afb6 None admin] Validating token access rules against request {{(pid=88550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:05:53.666627 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6dbd130-f14e-4c1b-bc86-d75cf422c54b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '819d41a279e64291acc60de51e1530ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:05:53.667621 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6dbd130-f14e-4c1b-bc86-d75cf422c54b None admin] REQUEST_METHOD: `GET` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:05:53.668162 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6dbd130-f14e-4c1b-bc86-d75cf422c54b None admin] SCRIPT_NAME: `/identity` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:05:53.668658 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6dbd130-f14e-4c1b-bc86-d75cf422c54b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:05:53.669642 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6dbd130-f14e-4c1b-bc86-d75cf422c54b None admin] RBAC: Adding query filter params (role.id=e46917e94e2e4018b346d95b26d804eb, user.id=d3c3cbc565214959bfce57d44a8dc244, scope.system=all) {{(pid=88550) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 19:05:53.670259 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6dbd130-f14e-4c1b-bc86-d75cf422c54b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:05:53.672399 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6dbd130-f14e-4c1b-bc86-d75cf422c54b None admin] RBAC: Authorization granted {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:05:53.682309 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: [pid: 88550|app: 0|req: 159/306] 10.222.0.26 () {56 vars in 1308 bytes} [Wed Aug 17 19:05:53 2022] GET /identity/v3/role_assignments?user.id=d3c3cbc565214959bfce57d44a8dc244&scope.system=all&role.id=e46917e94e2e4018b346d95b26d804eb => generated 226 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 17 19:05:53.756534 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec376bb9-054f-4ed1-825e-d9d2a1e43262 None admin] Validating token access rules against request {{(pid=88551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:05:53.800210 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb41fd54-425d-433e-af3c-2c05642dbf48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '819d41a279e64291acc60de51e1530ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:05:53.800868 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb41fd54-425d-433e-af3c-2c05642dbf48 None admin] REQUEST_METHOD: `GET` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:05:53.801150 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb41fd54-425d-433e-af3c-2c05642dbf48 None admin] SCRIPT_NAME: `/identity` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:05:53.801424 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb41fd54-425d-433e-af3c-2c05642dbf48 None admin] PATH_INFO: `/v3/roles/member` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:05:53.814718 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb41fd54-425d-433e-af3c-2c05642dbf48 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 17 19:05:53.821026 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application [None req-bb41fd54-425d-433e-af3c-2c05642dbf48 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 17 19:05:53.821026 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 19:05:53.821026 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 19:05:53.821026 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 19:05:53.821026 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 19:05:53.821026 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 19:05:53.821026 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 19:05:53.821026 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 19:05:53.821026 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 19:05:53.821026 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 19:05:53.821026 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 19:05:53.821026 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 19:05:53.821026 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 17 19:05:53.821026 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 17 19:05:53.821026 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 17 19:05:53.821026 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 17 19:05:53.821972 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 17 19:05:53.821972 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 17 19:05:53.821972 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 17 19:05:53.821972 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 17 19:05:53.821972 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 19:05:53.821972 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 19:05:53.821972 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 19:05:53.821972 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 19:05:53.821972 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 19:05:53.821972 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 19:05:53.821972 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 19:05:53.821972 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application with Lock( Aug 17 19:05:53.821972 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 19:05:53.821972 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application return self._enter() Aug 17 19:05:53.821972 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 19:05:53.821972 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 19:05:53.822824 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 19:05:53.822824 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application return self.creator() Aug 17 19:05:53.822824 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 19:05:53.822824 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application created_value = creator( Aug 17 19:05:53.822824 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 17 19:05:53.822824 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 17 19:05:53.822824 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 17 19:05:53.822824 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 17 19:05:53.822824 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 17 19:05:53.822824 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 17 19:05:53.822824 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 17 19:05:53.822824 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application Aug 17 19:05:53.822824 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: [pid: 88551|app: 0|req: 148/307] 10.222.0.26 () {56 vars in 1099 bytes} [Wed Aug 17 19:05:53 2022] GET /identity/v3/roles/member => generated 84 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 19:05:53.830374 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6dbd130-f14e-4c1b-bc86-d75cf422c54b None admin] Authenticating user token {{(pid=88550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:05:53.937885 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG dbcounter [-] [88550] Writing DB stats keystone:SELECT=100 {{(pid=88550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:05:53.951550 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af7335d8-3341-4746-9421-c41a6f901a36 None None] REQUEST_METHOD: `GET` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:05:53.951838 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af7335d8-3341-4746-9421-c41a6f901a36 None None] SCRIPT_NAME: `/identity` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:05:53.952671 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af7335d8-3341-4746-9421-c41a6f901a36 None None] PATH_INFO: `/` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:05:53.954141 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: [pid: 88551|app: 0|req: 149/308] 10.222.0.26 () {54 vars in 927 bytes} [Wed Aug 17 19:05:53 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 17 19:05:53.959273 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a9f1fc7-e2ff-44c6-9d4f-983eb1e36cc7 None None] REQUEST_METHOD: `POST` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:05:53.959558 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a9f1fc7-e2ff-44c6-9d4f-983eb1e36cc7 None None] SCRIPT_NAME: `/identity` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:05:53.959829 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a9f1fc7-e2ff-44c6-9d4f-983eb1e36cc7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:05:53.971071 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6dbd130-f14e-4c1b-bc86-d75cf422c54b None admin] Validating token access rules against request {{(pid=88550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:05:53.978716 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.auth.core [None req-6a9f1fc7-e2ff-44c6-9d4f-983eb1e36cc7 None None] MFA Rules not processed for user `819d41a279e64291acc60de51e1530ae`. Rule list: `[]` (Enabled: `True`). {{(pid=88551) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 19:05:53.979907 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.common.fernet_utils [None req-6a9f1fc7-e2ff-44c6-9d4f-983eb1e36cc7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:05:54.014230 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98acb018-d479-48d8-8ae2-278b366c1c50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '819d41a279e64291acc60de51e1530ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:05:54.015133 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98acb018-d479-48d8-8ae2-278b366c1c50 None admin] REQUEST_METHOD: `GET` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:05:54.015278 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98acb018-d479-48d8-8ae2-278b366c1c50 None admin] SCRIPT_NAME: `/identity` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:05:54.015486 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98acb018-d479-48d8-8ae2-278b366c1c50 None admin] PATH_INFO: `/v3/roles` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:05:54.016131 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98acb018-d479-48d8-8ae2-278b366c1c50 None admin] RBAC: Adding query filter params (name=member) {{(pid=88550) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 19:05:54.016435 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98acb018-d479-48d8-8ae2-278b366c1c50 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:05:54.017832 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98acb018-d479-48d8-8ae2-278b366c1c50 None admin] RBAC: Authorization granted {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:05:54.025342 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG dbcounter [-] [88551] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:05:54.026587 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: [pid: 88550|app: 0|req: 160/309] 10.222.0.26 () {56 vars in 1101 bytes} [Wed Aug 17 19:05:53 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 17 19:05:54.031608 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98acb018-d479-48d8-8ae2-278b366c1c50 None admin] Authenticating user token {{(pid=88550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:05:54.075866 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: [pid: 88551|app: 0|req: 150/310] 10.222.0.26 () {58 vars in 1024 bytes} [Wed Aug 17 19:05:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 17 19:05:54.155909 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98acb018-d479-48d8-8ae2-278b366c1c50 None admin] Validating token access rules against request {{(pid=88550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:05:54.191312 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-157b018e-6a22-43aa-9ffc-ca510952cbfa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '819d41a279e64291acc60de51e1530ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:05:54.192268 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-157b018e-6a22-43aa-9ffc-ca510952cbfa None admin] REQUEST_METHOD: `GET` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:05:54.192779 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-157b018e-6a22-43aa-9ffc-ca510952cbfa None admin] SCRIPT_NAME: `/identity` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:05:54.193245 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-157b018e-6a22-43aa-9ffc-ca510952cbfa None admin] PATH_INFO: `/v3/users/da7bffd2f6834519abd0642b11f19550` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:05:54.194575 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-157b018e-6a22-43aa-9ffc-ca510952cbfa None admin] RBAC: Authorizing `identity:get_user(user_id=da7bffd2f6834519abd0642b11f19550)` {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:05:54.196226 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-157b018e-6a22-43aa-9ffc-ca510952cbfa None admin] RBAC: Authorization granted {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:05:54.198325 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: [pid: 88550|app: 0|req: 161/311] 10.222.0.26 () {56 vars in 1177 bytes} [Wed Aug 17 19:05:54 2022] GET /identity/v3/users/da7bffd2f6834519abd0642b11f19550 => generated 293 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 19:05:54.204724 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a9f1fc7-e2ff-44c6-9d4f-983eb1e36cc7 None None] Authenticating user token {{(pid=88551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:05:54.316967 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a9f1fc7-e2ff-44c6-9d4f-983eb1e36cc7 None None] Validating token access rules against request {{(pid=88551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:05:54.353376 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c34c2ab-df79-45f4-8b96-2838faf9377b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '819d41a279e64291acc60de51e1530ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:05:54.354021 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c34c2ab-df79-45f4-8b96-2838faf9377b None admin] REQUEST_METHOD: `PUT` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:05:54.354298 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c34c2ab-df79-45f4-8b96-2838faf9377b None admin] SCRIPT_NAME: `/identity` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:05:54.354639 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c34c2ab-df79-45f4-8b96-2838faf9377b None admin] PATH_INFO: `/v3/system/users/da7bffd2f6834519abd0642b11f19550/roles/748773430faa4030989e1e77b3f361e1` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:05:54.356171 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c34c2ab-df79-45f4-8b96-2838faf9377b None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=da7bffd2f6834519abd0642b11f19550, role_id=748773430faa4030989e1e77b3f361e1)` {{(pid=88551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:05:54.357531 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c34c2ab-df79-45f4-8b96-2838faf9377b None admin] RBAC: Authorization granted {{(pid=88551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:05:54.447782 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-157b018e-6a22-43aa-9ffc-ca510952cbfa None admin] Authenticating user token {{(pid=88550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:05:54.457965 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG dbcounter [-] [88550] Writing DB stats keystone:SELECT=100 {{(pid=88550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:05:54.476302 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: [pid: 88551|app: 0|req: 151/312] 10.222.0.26 () {58 vars in 1334 bytes} [Wed Aug 17 19:05:54 2022] PUT /identity/v3/system/users/da7bffd2f6834519abd0642b11f19550/roles/748773430faa4030989e1e77b3f361e1 => generated 0 bytes in 272 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 19:05:54.570232 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-157b018e-6a22-43aa-9ffc-ca510952cbfa None admin] Validating token access rules against request {{(pid=88550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:05:54.609954 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7ab7e58-d325-4ad8-ac6c-419bb36f1278 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '819d41a279e64291acc60de51e1530ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:05:54.611034 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ab7e58-d325-4ad8-ac6c-419bb36f1278 None admin] REQUEST_METHOD: `GET` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:05:54.611517 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ab7e58-d325-4ad8-ac6c-419bb36f1278 None admin] SCRIPT_NAME: `/identity` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:05:54.612013 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ab7e58-d325-4ad8-ac6c-419bb36f1278 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:05:54.625638 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7ab7e58-d325-4ad8-ac6c-419bb36f1278 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 17 19:05:54.632023 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application [None req-d7ab7e58-d325-4ad8-ac6c-419bb36f1278 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 17 19:05:54.632023 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 19:05:54.632023 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 19:05:54.632023 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 19:05:54.632023 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 19:05:54.632023 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 19:05:54.632023 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 19:05:54.632023 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 19:05:54.632023 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 19:05:54.632023 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 19:05:54.632023 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 19:05:54.632023 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 19:05:54.632023 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 17 19:05:54.632023 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 17 19:05:54.632023 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 17 19:05:54.632023 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 17 19:05:54.633017 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 17 19:05:54.633017 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 17 19:05:54.633017 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 17 19:05:54.633017 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 17 19:05:54.633017 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 19:05:54.633017 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 19:05:54.633017 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 19:05:54.633017 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 19:05:54.633017 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 19:05:54.633017 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 19:05:54.633017 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 19:05:54.633017 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application with Lock( Aug 17 19:05:54.633017 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 19:05:54.633017 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return self._enter() Aug 17 19:05:54.633017 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 19:05:54.633017 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 19:05:54.633821 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 19:05:54.633821 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return self.creator() Aug 17 19:05:54.633821 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 19:05:54.633821 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application created_value = creator( Aug 17 19:05:54.633821 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 17 19:05:54.633821 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 17 19:05:54.633821 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 17 19:05:54.633821 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 17 19:05:54.633821 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 17 19:05:54.633821 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 17 19:05:54.633821 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 17 19:05:54.633821 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application Aug 17 19:05:54.636510 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: [pid: 88550|app: 0|req: 162/313] 10.222.0.26 () {56 vars in 1099 bytes} [Wed Aug 17 19:05:54 2022] GET /identity/v3/roles/reader => generated 84 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 17 19:05:54.643968 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c34c2ab-df79-45f4-8b96-2838faf9377b None admin] Authenticating user token {{(pid=88551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:05:54.683370 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG dbcounter [-] [88551] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:05:54.758170 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c34c2ab-df79-45f4-8b96-2838faf9377b None admin] Validating token access rules against request {{(pid=88551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:05:54.800586 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ce17c46-6192-4752-b20f-3898329a7483 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '819d41a279e64291acc60de51e1530ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:05:54.801196 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce17c46-6192-4752-b20f-3898329a7483 None admin] REQUEST_METHOD: `GET` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:05:54.801478 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce17c46-6192-4752-b20f-3898329a7483 None admin] SCRIPT_NAME: `/identity` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:05:54.801749 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce17c46-6192-4752-b20f-3898329a7483 None admin] PATH_INFO: `/v3/roles` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:05:54.802424 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ce17c46-6192-4752-b20f-3898329a7483 None admin] RBAC: Adding query filter params (name=reader) {{(pid=88551) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 19:05:54.802760 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ce17c46-6192-4752-b20f-3898329a7483 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:05:54.804133 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ce17c46-6192-4752-b20f-3898329a7483 None admin] RBAC: Authorization granted {{(pid=88551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:05:54.814000 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: [pid: 88551|app: 0|req: 152/314] 10.222.0.26 () {56 vars in 1101 bytes} [Wed Aug 17 19:05:54 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 19:05:54.823636 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7ab7e58-d325-4ad8-ac6c-419bb36f1278 None admin] Authenticating user token {{(pid=88550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:05:54.895964 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG dbcounter [-] [88550] Writing DB stats keystone:SELECT=100 {{(pid=88550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:05:54.932631 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7ab7e58-d325-4ad8-ac6c-419bb36f1278 None admin] Validating token access rules against request {{(pid=88550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:05:54.969156 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6173b81c-a565-4103-8d3d-96490e096eae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '819d41a279e64291acc60de51e1530ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:05:54.969795 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6173b81c-a565-4103-8d3d-96490e096eae None admin] REQUEST_METHOD: `GET` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:05:54.970076 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6173b81c-a565-4103-8d3d-96490e096eae None admin] SCRIPT_NAME: `/identity` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:05:54.970348 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6173b81c-a565-4103-8d3d-96490e096eae None admin] PATH_INFO: `/v3/users/d3148b713c4c4b3b97030eea9ae825d9` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:05:54.971554 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6173b81c-a565-4103-8d3d-96490e096eae None admin] RBAC: Authorizing `identity:get_user(user_id=d3148b713c4c4b3b97030eea9ae825d9)` {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:05:54.972990 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6173b81c-a565-4103-8d3d-96490e096eae None admin] RBAC: Authorization granted {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:05:54.974770 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: [pid: 88550|app: 0|req: 163/315] 10.222.0.26 () {56 vars in 1177 bytes} [Wed Aug 17 19:05:54 2022] GET /identity/v3/users/d3148b713c4c4b3b97030eea9ae825d9 => generated 297 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 19:05:54.980148 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ce17c46-6192-4752-b20f-3898329a7483 None admin] Authenticating user token {{(pid=88551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:05:55.085244 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG dbcounter [-] [88551] Writing DB stats keystone:SELECT=100 {{(pid=88551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:05:55.092009 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ce17c46-6192-4752-b20f-3898329a7483 None admin] Validating token access rules against request {{(pid=88551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:05:55.127970 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f479455f-1992-498d-86cf-2d8456350ab1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '819d41a279e64291acc60de51e1530ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:05:55.128608 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f479455f-1992-498d-86cf-2d8456350ab1 None admin] REQUEST_METHOD: `GET` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:05:55.128913 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f479455f-1992-498d-86cf-2d8456350ab1 None admin] SCRIPT_NAME: `/identity` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:05:55.129203 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f479455f-1992-498d-86cf-2d8456350ab1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:05:55.200167 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f479455f-1992-498d-86cf-2d8456350ab1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:05:55.201640 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f479455f-1992-498d-86cf-2d8456350ab1 None admin] RBAC: Authorization granted {{(pid=88551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:05:55.299766 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG dbcounter [-] [88551] Writing DB stats keystone:SELECT=100 {{(pid=88551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:05:55.307187 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: [pid: 88551|app: 0|req: 153/316] 10.222.0.26 () {58 vars in 1282 bytes} [Wed Aug 17 19:05:54 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 328 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 17 19:05:55.313072 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6173b81c-a565-4103-8d3d-96490e096eae None admin] Authenticating user token {{(pid=88550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:05:55.414926 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6173b81c-a565-4103-8d3d-96490e096eae None admin] Validating token access rules against request {{(pid=88550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:05:55.448942 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83888499-5d5a-4933-b52b-f406d39bff3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '819d41a279e64291acc60de51e1530ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:05:55.449575 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83888499-5d5a-4933-b52b-f406d39bff3d None admin] REQUEST_METHOD: `GET` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:05:55.449854 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83888499-5d5a-4933-b52b-f406d39bff3d None admin] SCRIPT_NAME: `/identity` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:05:55.450123 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83888499-5d5a-4933-b52b-f406d39bff3d None admin] PATH_INFO: `/v3/projects/4ebe56b7d67e4584afee4a218097f2b4` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:05:55.451269 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83888499-5d5a-4933-b52b-f406d39bff3d None admin] RBAC: Authorizing `identity:get_project(project_id=4ebe56b7d67e4584afee4a218097f2b4)` {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:05:55.453266 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83888499-5d5a-4933-b52b-f406d39bff3d None admin] RBAC: Authorization granted {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:05:55.455251 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: [pid: 88550|app: 0|req: 164/317] 10.222.0.26 () {56 vars in 1186 bytes} [Wed Aug 17 19:05:55 2022] GET /identity/v3/projects/4ebe56b7d67e4584afee4a218097f2b4 => generated 302 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 19:05:55.461172 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f479455f-1992-498d-86cf-2d8456350ab1 None admin] Authenticating user token {{(pid=88551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:05:55.564807 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f479455f-1992-498d-86cf-2d8456350ab1 None admin] Validating token access rules against request {{(pid=88551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:05:55.601355 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd0b47d7-966c-4670-9150-27ca08be34cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '819d41a279e64291acc60de51e1530ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:05:55.601961 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd0b47d7-966c-4670-9150-27ca08be34cc None admin] REQUEST_METHOD: `GET` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:05:55.602237 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd0b47d7-966c-4670-9150-27ca08be34cc None admin] SCRIPT_NAME: `/identity` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:05:55.602504 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd0b47d7-966c-4670-9150-27ca08be34cc None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:05:55.603258 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd0b47d7-966c-4670-9150-27ca08be34cc None admin] RBAC: Adding query filter params (role.id=e46917e94e2e4018b346d95b26d804eb, scope.project.id=4ebe56b7d67e4584afee4a218097f2b4, user.id=d3148b713c4c4b3b97030eea9ae825d9) {{(pid=88551) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 19:05:55.603565 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd0b47d7-966c-4670-9150-27ca08be34cc None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:05:55.604995 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd0b47d7-966c-4670-9150-27ca08be34cc None admin] RBAC: Authorization granted {{(pid=88551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:05:55.611382 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: [pid: 88551|app: 0|req: 154/318] 10.222.0.26 () {56 vars in 1374 bytes} [Wed Aug 17 19:05:55 2022] GET /identity/v3/role_assignments?user.id=d3148b713c4c4b3b97030eea9ae825d9&scope.project.id=4ebe56b7d67e4584afee4a218097f2b4&role.id=e46917e94e2e4018b346d95b26d804eb => generated 608 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 19:05:55.954969 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6415a741-4d79-4783-8641-9ddbba608618 None None] REQUEST_METHOD: `GET` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:05:55.955479 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6415a741-4d79-4783-8641-9ddbba608618 None None] SCRIPT_NAME: `/identity` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:05:55.955553 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6415a741-4d79-4783-8641-9ddbba608618 None None] PATH_INFO: `/` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:05:55.957161 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: [pid: 88550|app: 0|req: 165/319] 10.222.0.26 () {54 vars in 927 bytes} [Wed Aug 17 19:05:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 19:05:55.964494 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f36d8e7f-4641-4487-8907-e3c2fe703091 None None] REQUEST_METHOD: `POST` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:05:55.964875 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f36d8e7f-4641-4487-8907-e3c2fe703091 None None] SCRIPT_NAME: `/identity` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:05:55.965110 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f36d8e7f-4641-4487-8907-e3c2fe703091 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:05:55.983293 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.auth.core [None req-f36d8e7f-4641-4487-8907-e3c2fe703091 None None] MFA Rules not processed for user `819d41a279e64291acc60de51e1530ae`. Rule list: `[]` (Enabled: `True`). {{(pid=88551) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 19:05:55.984626 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.common.fernet_utils [None req-f36d8e7f-4641-4487-8907-e3c2fe703091 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:05:56.040688 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG dbcounter [-] [88551] Writing DB stats keystone:SELECT=100 {{(pid=88551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:05:56.054431 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: [pid: 88551|app: 0|req: 155/320] 10.222.0.26 () {58 vars in 1024 bytes} [Wed Aug 17 19:05:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 17 19:05:56.099294 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78bf6120-699e-435c-93a8-f1e1c56d9a48 None None] REQUEST_METHOD: `GET` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:05:56.099601 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78bf6120-699e-435c-93a8-f1e1c56d9a48 None None] SCRIPT_NAME: `/identity` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:05:56.099872 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78bf6120-699e-435c-93a8-f1e1c56d9a48 None None] PATH_INFO: `/` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:05:56.101387 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: [pid: 88550|app: 0|req: 166/321] 10.222.0.26 () {54 vars in 927 bytes} [Wed Aug 17 19:05:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 19:05:56.106399 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1747973e-9c7d-47f3-9a1d-e2b307333588 None None] REQUEST_METHOD: `POST` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:05:56.106698 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1747973e-9c7d-47f3-9a1d-e2b307333588 None None] SCRIPT_NAME: `/identity` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:05:56.106972 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1747973e-9c7d-47f3-9a1d-e2b307333588 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:05:56.126017 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.auth.core [None req-1747973e-9c7d-47f3-9a1d-e2b307333588 None None] MFA Rules not processed for user `819d41a279e64291acc60de51e1530ae`. Rule list: `[]` (Enabled: `True`). {{(pid=88551) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 19:05:56.127435 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.common.fernet_utils [None req-1747973e-9c7d-47f3-9a1d-e2b307333588 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:05:56.197111 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: [pid: 88551|app: 0|req: 156/322] 10.222.0.26 () {58 vars in 1024 bytes} [Wed Aug 17 19:05:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 17 19:05:56.390930 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78bf6120-699e-435c-93a8-f1e1c56d9a48 None None] Authenticating user token {{(pid=88550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:05:56.393858 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG dbcounter [-] [88550] Writing DB stats keystone:SELECT=100 {{(pid=88550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:05:56.494483 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78bf6120-699e-435c-93a8-f1e1c56d9a48 None None] Validating token access rules against request {{(pid=88550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:05:56.522846 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1747973e-9c7d-47f3-9a1d-e2b307333588 None None] Authenticating user token {{(pid=88551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:05:56.610211 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf9be77c-4140-4ec5-8e84-b14e6970940f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '819d41a279e64291acc60de51e1530ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:05:56.610867 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf9be77c-4140-4ec5-8e84-b14e6970940f None admin] REQUEST_METHOD: `GET` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:05:56.611146 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf9be77c-4140-4ec5-8e84-b14e6970940f None admin] SCRIPT_NAME: `/identity` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:05:56.611417 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf9be77c-4140-4ec5-8e84-b14e6970940f None admin] PATH_INFO: `/v3/domains/default` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:05:56.612522 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf9be77c-4140-4ec5-8e84-b14e6970940f None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:05:56.613962 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf9be77c-4140-4ec5-8e84-b14e6970940f None admin] RBAC: Authorization granted {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:05:56.615564 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: [pid: 88550|app: 0|req: 167/323] 10.222.0.26 () {56 vars in 1108 bytes} [Wed Aug 17 19:05:56 2022] GET /identity/v3/domains/default => generated 199 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 19:05:56.621021 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf9be77c-4140-4ec5-8e84-b14e6970940f None admin] Authenticating user token {{(pid=88550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:05:56.687804 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1747973e-9c7d-47f3-9a1d-e2b307333588 None None] Validating token access rules against request {{(pid=88551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:05:56.693421 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG dbcounter [-] [88550] Writing DB stats keystone:SELECT=100 {{(pid=88550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:05:56.709632 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG dbcounter [-] [88551] Writing DB stats keystone:SELECT=100 {{(pid=88551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:05:56.725806 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf9be77c-4140-4ec5-8e84-b14e6970940f None admin] Validating token access rules against request {{(pid=88550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:05:56.727002 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b9a0a61-a77f-4bf3-b367-c56328a898be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '819d41a279e64291acc60de51e1530ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:05:56.727624 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b9a0a61-a77f-4bf3-b367-c56328a898be None admin] REQUEST_METHOD: `GET` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:05:56.727909 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b9a0a61-a77f-4bf3-b367-c56328a898be None admin] SCRIPT_NAME: `/identity` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:05:56.728178 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b9a0a61-a77f-4bf3-b367-c56328a898be None admin] PATH_INFO: `/v3/roles/reader` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:05:56.739429 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b9a0a61-a77f-4bf3-b367-c56328a898be None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 17 19:05:56.744895 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application [None req-9b9a0a61-a77f-4bf3-b367-c56328a898be None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 17 19:05:56.744895 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 19:05:56.744895 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 19:05:56.744895 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 19:05:56.744895 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 19:05:56.744895 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 19:05:56.744895 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 19:05:56.744895 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 19:05:56.744895 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 19:05:56.744895 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 19:05:56.744895 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 19:05:56.744895 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 19:05:56.744895 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 17 19:05:56.744895 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 17 19:05:56.744895 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 17 19:05:56.744895 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 17 19:05:56.746008 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 17 19:05:56.746008 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 17 19:05:56.746008 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 17 19:05:56.746008 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 17 19:05:56.746008 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 19:05:56.746008 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 19:05:56.746008 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 19:05:56.746008 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 19:05:56.746008 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 19:05:56.746008 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 19:05:56.746008 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 19:05:56.746008 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application with Lock( Aug 17 19:05:56.746008 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 19:05:56.746008 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application return self._enter() Aug 17 19:05:56.746008 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 19:05:56.746008 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 19:05:56.746864 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 19:05:56.746864 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application return self.creator() Aug 17 19:05:56.746864 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 19:05:56.746864 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application created_value = creator( Aug 17 19:05:56.746864 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 17 19:05:56.746864 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 17 19:05:56.746864 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 17 19:05:56.746864 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 17 19:05:56.746864 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 17 19:05:56.746864 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 17 19:05:56.746864 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 17 19:05:56.746864 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application Aug 17 19:05:56.746864 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: [pid: 88551|app: 0|req: 157/324] 10.222.0.26 () {56 vars in 1099 bytes} [Wed Aug 17 19:05:56 2022] GET /identity/v3/roles/reader => generated 84 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 17 19:05:56.752109 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b9a0a61-a77f-4bf3-b367-c56328a898be None admin] Authenticating user token {{(pid=88551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:05:56.769081 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9df895ee-3203-4380-9163-dd33e83252d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '819d41a279e64291acc60de51e1530ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:05:56.769694 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df895ee-3203-4380-9163-dd33e83252d2 None admin] REQUEST_METHOD: `POST` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:05:56.770003 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df895ee-3203-4380-9163-dd33e83252d2 None admin] SCRIPT_NAME: `/identity` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:05:56.770288 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df895ee-3203-4380-9163-dd33e83252d2 None admin] PATH_INFO: `/v3/groups` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:05:56.771003 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9df895ee-3203-4380-9163-dd33e83252d2 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:05:56.772444 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9df895ee-3203-4380-9163-dd33e83252d2 None admin] RBAC: Authorization granted {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:05:56.853384 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b9a0a61-a77f-4bf3-b367-c56328a898be None admin] Validating token access rules against request {{(pid=88551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:05:56.886518 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: [pid: 88550|app: 0|req: 168/325] 10.222.0.26 () {60 vars in 1134 bytes} [Wed Aug 17 19:05:56 2022] POST /identity/v3/groups => generated 226 bytes in 266 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 17 19:05:56.887802 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96afcc9b-5dcc-4ff0-a5c7-c40e88f6452f None None] REQUEST_METHOD: `GET` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:05:56.888094 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96afcc9b-5dcc-4ff0-a5c7-c40e88f6452f None None] SCRIPT_NAME: `/identity` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:05:56.888256 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec7f22f3-54e1-466f-908c-4a2a71a1bcd1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '819d41a279e64291acc60de51e1530ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:05:56.888418 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96afcc9b-5dcc-4ff0-a5c7-c40e88f6452f None None] PATH_INFO: `/` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:05:56.888950 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec7f22f3-54e1-466f-908c-4a2a71a1bcd1 None admin] REQUEST_METHOD: `GET` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:05:56.889261 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec7f22f3-54e1-466f-908c-4a2a71a1bcd1 None admin] SCRIPT_NAME: `/identity` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:05:56.890053 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec7f22f3-54e1-466f-908c-4a2a71a1bcd1 None admin] PATH_INFO: `/v3/roles` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:05:56.890160 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: [pid: 88550|app: 0|req: 169/326] 10.222.0.26 () {54 vars in 927 bytes} [Wed Aug 17 19:05:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 19:05:56.890782 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec7f22f3-54e1-466f-908c-4a2a71a1bcd1 None admin] RBAC: Adding query filter params (name=reader) {{(pid=88551) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 19:05:56.891081 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec7f22f3-54e1-466f-908c-4a2a71a1bcd1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:05:56.892555 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec7f22f3-54e1-466f-908c-4a2a71a1bcd1 None admin] RBAC: Authorization granted {{(pid=88551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:05:56.902470 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: [pid: 88551|app: 0|req: 158/327] 10.222.0.26 () {56 vars in 1101 bytes} [Wed Aug 17 19:05:56 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 17 19:05:56.908457 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de412f73-04dd-46cb-8a80-9ad1b1b55b25 None None] REQUEST_METHOD: `POST` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:05:56.908672 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec7f22f3-54e1-466f-908c-4a2a71a1bcd1 None admin] Authenticating user token {{(pid=88551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:05:56.908754 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de412f73-04dd-46cb-8a80-9ad1b1b55b25 None None] SCRIPT_NAME: `/identity` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:05:56.909178 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de412f73-04dd-46cb-8a80-9ad1b1b55b25 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:05:56.932944 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.auth.core [None req-de412f73-04dd-46cb-8a80-9ad1b1b55b25 None None] MFA Rules not processed for user `819d41a279e64291acc60de51e1530ae`. Rule list: `[]` (Enabled: `True`). {{(pid=88550) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 19:05:56.936017 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.common.fernet_utils [None req-de412f73-04dd-46cb-8a80-9ad1b1b55b25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:05:56.966509 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG dbcounter [-] [88551] Writing DB stats keystone:SELECT=100 {{(pid=88551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:05:57.010968 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: [pid: 88550|app: 0|req: 170/328] 10.222.0.26 () {58 vars in 1024 bytes} [Wed Aug 17 19:05:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 17 19:05:57.035720 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec7f22f3-54e1-466f-908c-4a2a71a1bcd1 None admin] Validating token access rules against request {{(pid=88551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:05:57.072353 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-895553f5-75b0-4a1f-994f-4e4533c673e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '819d41a279e64291acc60de51e1530ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:05:57.073047 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-895553f5-75b0-4a1f-994f-4e4533c673e4 None admin] REQUEST_METHOD: `GET` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:05:57.073334 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-895553f5-75b0-4a1f-994f-4e4533c673e4 None admin] SCRIPT_NAME: `/identity` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:05:57.073614 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-895553f5-75b0-4a1f-994f-4e4533c673e4 None admin] PATH_INFO: `/v3/users/d3c3cbc565214959bfce57d44a8dc244` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:05:57.074862 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-895553f5-75b0-4a1f-994f-4e4533c673e4 None admin] RBAC: Authorizing `identity:get_user(user_id=d3c3cbc565214959bfce57d44a8dc244)` {{(pid=88551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:05:57.076343 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-895553f5-75b0-4a1f-994f-4e4533c673e4 None admin] RBAC: Authorization granted {{(pid=88551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:05:57.078689 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: [pid: 88551|app: 0|req: 159/329] 10.222.0.26 () {56 vars in 1177 bytes} [Wed Aug 17 19:05:56 2022] GET /identity/v3/users/d3c3cbc565214959bfce57d44a8dc244 => generated 293 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 19:05:57.084174 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de412f73-04dd-46cb-8a80-9ad1b1b55b25 None None] Authenticating user token {{(pid=88550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:05:57.146951 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG dbcounter [-] [88550] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:05:57.189765 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de412f73-04dd-46cb-8a80-9ad1b1b55b25 None None] Validating token access rules against request {{(pid=88550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:05:57.243224 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8996653c-1324-47a3-96c5-d3e7cb9beef5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '819d41a279e64291acc60de51e1530ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:05:57.244284 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8996653c-1324-47a3-96c5-d3e7cb9beef5 None admin] REQUEST_METHOD: `PUT` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:05:57.244772 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8996653c-1324-47a3-96c5-d3e7cb9beef5 None admin] SCRIPT_NAME: `/identity` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:05:57.245289 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8996653c-1324-47a3-96c5-d3e7cb9beef5 None admin] PATH_INFO: `/v3/system/users/d3c3cbc565214959bfce57d44a8dc244/roles/e46917e94e2e4018b346d95b26d804eb` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:05:57.247088 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8996653c-1324-47a3-96c5-d3e7cb9beef5 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=d3c3cbc565214959bfce57d44a8dc244, role_id=e46917e94e2e4018b346d95b26d804eb)` {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:05:57.249255 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8996653c-1324-47a3-96c5-d3e7cb9beef5 None admin] RBAC: Authorization granted {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:05:57.315451 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: [pid: 88550|app: 0|req: 171/330] 10.222.0.26 () {58 vars in 1334 bytes} [Wed Aug 17 19:05:57 2022] PUT /identity/v3/system/users/d3c3cbc565214959bfce57d44a8dc244/roles/e46917e94e2e4018b346d95b26d804eb => generated 0 bytes in 231 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 19:05:57.345787 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-895553f5-75b0-4a1f-994f-4e4533c673e4 None admin] Authenticating user token {{(pid=88551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:05:57.469831 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-895553f5-75b0-4a1f-994f-4e4533c673e4 None admin] Validating token access rules against request {{(pid=88551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:05:57.480613 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG dbcounter [-] [88551] Writing DB stats keystone:SELECT=100 {{(pid=88551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:05:57.513122 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5badba99-7191-4a07-a76a-04e25c786375 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '819d41a279e64291acc60de51e1530ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:05:57.513775 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5badba99-7191-4a07-a76a-04e25c786375 None admin] REQUEST_METHOD: `GET` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:05:57.514053 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5badba99-7191-4a07-a76a-04e25c786375 None admin] SCRIPT_NAME: `/identity` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:05:57.514345 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5badba99-7191-4a07-a76a-04e25c786375 None admin] PATH_INFO: `/v3/roles/member` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:05:57.530462 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5badba99-7191-4a07-a76a-04e25c786375 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 17 19:05:57.535303 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application [None req-5badba99-7191-4a07-a76a-04e25c786375 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 17 19:05:57.535303 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 19:05:57.535303 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 19:05:57.535303 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 19:05:57.535303 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 19:05:57.535303 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 19:05:57.535303 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 19:05:57.535303 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 19:05:57.535303 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 19:05:57.535303 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 19:05:57.535303 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 19:05:57.535303 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 19:05:57.535303 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 17 19:05:57.535303 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 17 19:05:57.535303 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 17 19:05:57.535303 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 17 19:05:57.536217 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 17 19:05:57.536217 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 17 19:05:57.536217 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 17 19:05:57.536217 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 17 19:05:57.536217 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 19:05:57.536217 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 19:05:57.536217 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 19:05:57.536217 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 19:05:57.536217 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 19:05:57.536217 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 19:05:57.536217 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 19:05:57.536217 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application with Lock( Aug 17 19:05:57.536217 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 19:05:57.536217 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application return self._enter() Aug 17 19:05:57.536217 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 19:05:57.536217 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 19:05:57.537025 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 19:05:57.537025 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application return self.creator() Aug 17 19:05:57.537025 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 19:05:57.537025 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application created_value = creator( Aug 17 19:05:57.537025 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 17 19:05:57.537025 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 17 19:05:57.537025 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 17 19:05:57.537025 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 17 19:05:57.537025 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 17 19:05:57.537025 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 17 19:05:57.537025 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 17 19:05:57.537025 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application Aug 17 19:05:57.537025 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: [pid: 88551|app: 0|req: 160/331] 10.222.0.26 () {56 vars in 1099 bytes} [Wed Aug 17 19:05:57 2022] GET /identity/v3/roles/member => generated 84 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 19:05:57.542476 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8996653c-1324-47a3-96c5-d3e7cb9beef5 None admin] Authenticating user token {{(pid=88550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:05:57.663608 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8996653c-1324-47a3-96c5-d3e7cb9beef5 None admin] Validating token access rules against request {{(pid=88550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:05:57.690402 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG dbcounter [-] [88550] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:05:57.703084 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beec2f56-1090-420d-a8e6-49ffde5403c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '819d41a279e64291acc60de51e1530ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:05:57.705152 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beec2f56-1090-420d-a8e6-49ffde5403c8 None admin] REQUEST_METHOD: `GET` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:05:57.705152 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beec2f56-1090-420d-a8e6-49ffde5403c8 None admin] SCRIPT_NAME: `/identity` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:05:57.705152 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beec2f56-1090-420d-a8e6-49ffde5403c8 None admin] PATH_INFO: `/v3/roles` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:05:57.705152 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beec2f56-1090-420d-a8e6-49ffde5403c8 None admin] RBAC: Adding query filter params (name=member) {{(pid=88550) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 19:05:57.705517 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beec2f56-1090-420d-a8e6-49ffde5403c8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:05:57.707064 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beec2f56-1090-420d-a8e6-49ffde5403c8 None admin] RBAC: Authorization granted {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:05:57.716483 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: [pid: 88550|app: 0|req: 172/332] 10.222.0.26 () {56 vars in 1101 bytes} [Wed Aug 17 19:05:57 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 19:05:57.722595 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5badba99-7191-4a07-a76a-04e25c786375 None admin] Authenticating user token {{(pid=88551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:05:57.853712 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5badba99-7191-4a07-a76a-04e25c786375 None admin] Validating token access rules against request {{(pid=88551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:05:57.896584 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e99d85f0-74c1-44dd-b9af-7b357485acb6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '819d41a279e64291acc60de51e1530ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:05:57.897224 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e99d85f0-74c1-44dd-b9af-7b357485acb6 None admin] REQUEST_METHOD: `GET` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:05:57.897506 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e99d85f0-74c1-44dd-b9af-7b357485acb6 None admin] SCRIPT_NAME: `/identity` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:05:57.897782 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e99d85f0-74c1-44dd-b9af-7b357485acb6 None admin] PATH_INFO: `/v3/users/da7bffd2f6834519abd0642b11f19550` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:05:57.901421 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e99d85f0-74c1-44dd-b9af-7b357485acb6 None admin] RBAC: Authorizing `identity:get_user(user_id=da7bffd2f6834519abd0642b11f19550)` {{(pid=88551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:05:57.903031 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e99d85f0-74c1-44dd-b9af-7b357485acb6 None admin] RBAC: Authorization granted {{(pid=88551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:05:57.905195 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: [pid: 88551|app: 0|req: 161/333] 10.222.0.26 () {56 vars in 1177 bytes} [Wed Aug 17 19:05:57 2022] GET /identity/v3/users/da7bffd2f6834519abd0642b11f19550 => generated 293 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 19:05:57.911249 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beec2f56-1090-420d-a8e6-49ffde5403c8 None admin] Authenticating user token {{(pid=88550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:05:58.031161 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beec2f56-1090-420d-a8e6-49ffde5403c8 None admin] Validating token access rules against request {{(pid=88550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:05:58.081681 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0444eaf1-f31b-4abf-b23e-f5e9d1783575 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '819d41a279e64291acc60de51e1530ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:05:58.082290 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0444eaf1-f31b-4abf-b23e-f5e9d1783575 None admin] REQUEST_METHOD: `GET` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:05:58.082735 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0444eaf1-f31b-4abf-b23e-f5e9d1783575 None admin] SCRIPT_NAME: `/identity` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:05:58.082900 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0444eaf1-f31b-4abf-b23e-f5e9d1783575 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:05:58.083600 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0444eaf1-f31b-4abf-b23e-f5e9d1783575 None admin] RBAC: Adding query filter params (role.id=748773430faa4030989e1e77b3f361e1, user.id=da7bffd2f6834519abd0642b11f19550, scope.system=all) {{(pid=88550) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 19:05:58.083910 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0444eaf1-f31b-4abf-b23e-f5e9d1783575 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:05:58.085364 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0444eaf1-f31b-4abf-b23e-f5e9d1783575 None admin] RBAC: Authorization granted {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:05:58.101710 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: [pid: 88550|app: 0|req: 173/334] 10.222.0.26 () {56 vars in 1308 bytes} [Wed Aug 17 19:05:57 2022] GET /identity/v3/role_assignments?user.id=da7bffd2f6834519abd0642b11f19550&scope.system=all&role.id=748773430faa4030989e1e77b3f361e1 => generated 510 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 19:05:59.875433 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd4d8b4f-607d-4791-ab96-50ef057f48ea None None] REQUEST_METHOD: `GET` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:05:59.875949 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd4d8b4f-607d-4791-ab96-50ef057f48ea None None] SCRIPT_NAME: `/identity` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:05:59.876055 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd4d8b4f-607d-4791-ab96-50ef057f48ea None None] PATH_INFO: `/` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:05:59.877649 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: [pid: 88551|app: 0|req: 162/335] 10.222.0.26 () {54 vars in 927 bytes} [Wed Aug 17 19:05:59 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 19:05:59.882829 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fcde1a2-e6ca-4f05-b4b2-9a8142d51569 None None] REQUEST_METHOD: `POST` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:05:59.883262 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fcde1a2-e6ca-4f05-b4b2-9a8142d51569 None None] SCRIPT_NAME: `/identity` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:05:59.883383 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fcde1a2-e6ca-4f05-b4b2-9a8142d51569 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:05:59.903470 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.auth.core [None req-3fcde1a2-e6ca-4f05-b4b2-9a8142d51569 None None] MFA Rules not processed for user `819d41a279e64291acc60de51e1530ae`. Rule list: `[]` (Enabled: `True`). {{(pid=88550) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 19:05:59.905157 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.common.fernet_utils [None req-3fcde1a2-e6ca-4f05-b4b2-9a8142d51569 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:05:59.954688 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG dbcounter [-] [88550] Writing DB stats keystone:SELECT=100 {{(pid=88550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:05:59.993361 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: [pid: 88550|app: 0|req: 174/336] 10.222.0.26 () {58 vars in 1024 bytes} [Wed Aug 17 19:05:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 17 19:06:00.211865 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f8486d-2b66-4aa3-a487-c0e0056f48c5 None None] REQUEST_METHOD: `GET` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:06:00.212168 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f8486d-2b66-4aa3-a487-c0e0056f48c5 None None] SCRIPT_NAME: `/identity` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:06:00.212345 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f8486d-2b66-4aa3-a487-c0e0056f48c5 None None] PATH_INFO: `/` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:06:00.213995 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: [pid: 88551|app: 0|req: 163/337] 10.222.0.26 () {54 vars in 927 bytes} [Wed Aug 17 19:06:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 19:06:00.228058 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db6f341-fb80-42a8-b1b9-1ada05a8f040 None None] REQUEST_METHOD: `POST` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:06:00.228650 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db6f341-fb80-42a8-b1b9-1ada05a8f040 None None] SCRIPT_NAME: `/identity` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:06:00.229147 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db6f341-fb80-42a8-b1b9-1ada05a8f040 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:06:00.253418 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.auth.core [None req-5db6f341-fb80-42a8-b1b9-1ada05a8f040 None None] MFA Rules not processed for user `819d41a279e64291acc60de51e1530ae`. Rule list: `[]` (Enabled: `True`). {{(pid=88550) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 19:06:00.255040 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.common.fernet_utils [None req-5db6f341-fb80-42a8-b1b9-1ada05a8f040 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:06:00.343085 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: [pid: 88550|app: 0|req: 175/338] 10.222.0.26 () {58 vars in 1024 bytes} [Wed Aug 17 19:06:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 17 19:06:00.363647 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccbd9538-40e4-4901-a74c-8a2f6a49403d None None] REQUEST_METHOD: `GET` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:06:00.363948 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccbd9538-40e4-4901-a74c-8a2f6a49403d None None] SCRIPT_NAME: `/identity` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:06:00.364202 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccbd9538-40e4-4901-a74c-8a2f6a49403d None None] PATH_INFO: `/` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:06:00.365873 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: [pid: 88551|app: 0|req: 164/339] 10.222.0.26 () {54 vars in 927 bytes} [Wed Aug 17 19:06:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 19:06:00.371011 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91963e9a-9bd2-4e83-b4ec-d2f001889829 None None] REQUEST_METHOD: `POST` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:06:00.371529 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91963e9a-9bd2-4e83-b4ec-d2f001889829 None None] SCRIPT_NAME: `/identity` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:06:00.372053 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91963e9a-9bd2-4e83-b4ec-d2f001889829 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:06:00.398591 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.auth.core [None req-91963e9a-9bd2-4e83-b4ec-d2f001889829 None None] MFA Rules not processed for user `819d41a279e64291acc60de51e1530ae`. Rule list: `[]` (Enabled: `True`). {{(pid=88550) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 19:06:00.400126 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.common.fernet_utils [None req-91963e9a-9bd2-4e83-b4ec-d2f001889829 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:06:00.490065 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: [pid: 88550|app: 0|req: 176/340] 10.222.0.26 () {58 vars in 1024 bytes} [Wed Aug 17 19:06:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 17 19:06:00.636913 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccbd9538-40e4-4901-a74c-8a2f6a49403d None None] Authenticating user token {{(pid=88551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:06:00.685730 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG dbcounter [-] [88551] Writing DB stats keystone:SELECT=100 {{(pid=88551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:06:00.732266 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b4734e-d974-4b56-9cad-75db2a4e65a5 None None] REQUEST_METHOD: `GET` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:06:00.732598 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b4734e-d974-4b56-9cad-75db2a4e65a5 None None] SCRIPT_NAME: `/identity` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:06:00.732821 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b4734e-d974-4b56-9cad-75db2a4e65a5 None None] PATH_INFO: `/` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:06:00.738088 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: [pid: 88550|app: 0|req: 177/341] 10.222.0.26 () {54 vars in 927 bytes} [Wed Aug 17 19:06:00 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 19:06:00.743874 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3139133d-66ce-4b08-92d7-13b4b41d391e None None] REQUEST_METHOD: `POST` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:06:00.744089 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3139133d-66ce-4b08-92d7-13b4b41d391e None None] SCRIPT_NAME: `/identity` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:06:00.744369 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3139133d-66ce-4b08-92d7-13b4b41d391e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:06:00.764807 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.auth.core [None req-3139133d-66ce-4b08-92d7-13b4b41d391e None None] MFA Rules not processed for user `819d41a279e64291acc60de51e1530ae`. Rule list: `[]` (Enabled: `True`). {{(pid=88550) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 19:06:00.766022 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.common.fernet_utils [None req-3139133d-66ce-4b08-92d7-13b4b41d391e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:06:00.767701 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccbd9538-40e4-4901-a74c-8a2f6a49403d None None] Validating token access rules against request {{(pid=88551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:06:00.813396 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG dbcounter [-] [88550] Writing DB stats keystone:SELECT=100 {{(pid=88550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:06:00.836278 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b142def-f956-4b88-a9b2-472dded4d672 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '819d41a279e64291acc60de51e1530ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:06:00.836914 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b142def-f956-4b88-a9b2-472dded4d672 None admin] REQUEST_METHOD: `GET` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:06:00.837333 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b142def-f956-4b88-a9b2-472dded4d672 None admin] SCRIPT_NAME: `/identity` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:06:00.837722 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b142def-f956-4b88-a9b2-472dded4d672 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:06:00.858936 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b142def-f956-4b88-a9b2-472dded4d672 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 17 19:06:00.869054 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application [None req-8b142def-f956-4b88-a9b2-472dded4d672 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 17 19:06:00.869054 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 19:06:00.869054 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 19:06:00.869054 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 19:06:00.869054 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 19:06:00.869054 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 19:06:00.869054 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 19:06:00.869054 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 19:06:00.869054 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 19:06:00.869054 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 19:06:00.869054 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 19:06:00.869054 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 19:06:00.869054 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 17 19:06:00.869054 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 17 19:06:00.869054 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 17 19:06:00.869054 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 17 19:06:00.870008 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 17 19:06:00.870008 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 17 19:06:00.870008 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 17 19:06:00.870008 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 17 19:06:00.870008 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 19:06:00.870008 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 19:06:00.870008 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 19:06:00.870008 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 19:06:00.870008 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 19:06:00.870008 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 19:06:00.870008 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 19:06:00.870008 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application with Lock( Aug 17 19:06:00.870008 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 19:06:00.870008 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application return self._enter() Aug 17 19:06:00.870008 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 19:06:00.870008 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 19:06:00.870864 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 19:06:00.870864 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application return self.creator() Aug 17 19:06:00.870864 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 19:06:00.870864 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application created_value = creator( Aug 17 19:06:00.870864 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 17 19:06:00.870864 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 17 19:06:00.870864 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 17 19:06:00.870864 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 17 19:06:00.870864 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 17 19:06:00.870864 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 17 19:06:00.870864 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 17 19:06:00.870864 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application Aug 17 19:06:00.878563 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: [pid: 88551|app: 0|req: 165/342] 10.222.0.26 () {56 vars in 1114 bytes} [Wed Aug 17 19:06:00 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 235 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 19:06:00.890412 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: [pid: 88550|app: 0|req: 178/343] 10.222.0.26 () {58 vars in 1024 bytes} [Wed Aug 17 19:06:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 17 19:06:00.900043 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b142def-f956-4b88-a9b2-472dded4d672 None admin] Authenticating user token {{(pid=88551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:06:01.038335 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG dbcounter [-] [88551] Writing DB stats keystone:SELECT=100 {{(pid=88551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:06:01.043578 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3139133d-66ce-4b08-92d7-13b4b41d391e None None] Authenticating user token {{(pid=88550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:06:01.046571 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b142def-f956-4b88-a9b2-472dded4d672 None admin] Validating token access rules against request {{(pid=88551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:06:01.101562 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0361888-4c44-4eda-8ef0-652d73dc10b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '819d41a279e64291acc60de51e1530ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:06:01.102421 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0361888-4c44-4eda-8ef0-652d73dc10b7 None admin] REQUEST_METHOD: `GET` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:06:01.102904 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0361888-4c44-4eda-8ef0-652d73dc10b7 None admin] SCRIPT_NAME: `/identity` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:06:01.103326 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0361888-4c44-4eda-8ef0-652d73dc10b7 None admin] PATH_INFO: `/v3/roles` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:06:01.104149 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0361888-4c44-4eda-8ef0-652d73dc10b7 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=88551) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 19:06:01.104632 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0361888-4c44-4eda-8ef0-652d73dc10b7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:06:01.106174 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0361888-4c44-4eda-8ef0-652d73dc10b7 None admin] RBAC: Authorization granted {{(pid=88551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:06:01.118487 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: [pid: 88551|app: 0|req: 166/344] 10.222.0.26 () {56 vars in 1111 bytes} [Wed Aug 17 19:06:00 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 19:06:01.119630 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0361888-4c44-4eda-8ef0-652d73dc10b7 None admin] Authenticating user token {{(pid=88551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:06:01.180113 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3139133d-66ce-4b08-92d7-13b4b41d391e None None] Validating token access rules against request {{(pid=88550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:06:01.224214 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f143184e-ac3d-43a7-b8c0-dd93e0cbac18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '819d41a279e64291acc60de51e1530ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:06:01.224867 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f143184e-ac3d-43a7-b8c0-dd93e0cbac18 None admin] REQUEST_METHOD: `GET` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:06:01.225152 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f143184e-ac3d-43a7-b8c0-dd93e0cbac18 None admin] SCRIPT_NAME: `/identity` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:06:01.225421 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f143184e-ac3d-43a7-b8c0-dd93e0cbac18 None admin] PATH_INFO: `/v3/roles/member` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:06:01.242521 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0361888-4c44-4eda-8ef0-652d73dc10b7 None admin] Validating token access rules against request {{(pid=88551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:06:01.251213 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f143184e-ac3d-43a7-b8c0-dd93e0cbac18 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 17 19:06:01.256871 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application [None req-f143184e-ac3d-43a7-b8c0-dd93e0cbac18 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 17 19:06:01.256871 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 19:06:01.256871 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 19:06:01.256871 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 19:06:01.256871 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 19:06:01.256871 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 19:06:01.256871 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 19:06:01.256871 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 19:06:01.256871 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 19:06:01.256871 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 19:06:01.256871 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 19:06:01.256871 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 19:06:01.256871 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 17 19:06:01.256871 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 17 19:06:01.256871 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 17 19:06:01.256871 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 17 19:06:01.257895 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 17 19:06:01.257895 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 17 19:06:01.257895 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 17 19:06:01.257895 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 17 19:06:01.257895 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 19:06:01.257895 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 19:06:01.257895 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 19:06:01.257895 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 19:06:01.257895 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 19:06:01.257895 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 19:06:01.257895 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 19:06:01.257895 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application with Lock( Aug 17 19:06:01.257895 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 19:06:01.257895 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return self._enter() Aug 17 19:06:01.257895 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 19:06:01.257895 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 19:06:01.258779 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 19:06:01.258779 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return self.creator() Aug 17 19:06:01.258779 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 19:06:01.258779 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application created_value = creator( Aug 17 19:06:01.258779 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 17 19:06:01.258779 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 17 19:06:01.258779 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 17 19:06:01.258779 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 17 19:06:01.258779 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 17 19:06:01.258779 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 17 19:06:01.258779 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 17 19:06:01.258779 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application Aug 17 19:06:01.261085 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: [pid: 88550|app: 0|req: 179/345] 10.222.0.26 () {56 vars in 1099 bytes} [Wed Aug 17 19:06:01 2022] GET /identity/v3/roles/member => generated 84 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 17 19:06:01.262075 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f143184e-ac3d-43a7-b8c0-dd93e0cbac18 None admin] Authenticating user token {{(pid=88550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:06:01.283193 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f80bbab5-ebca-49db-ac0b-677711be8388 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '819d41a279e64291acc60de51e1530ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:06:01.283888 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f80bbab5-ebca-49db-ac0b-677711be8388 None admin] REQUEST_METHOD: `GET` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:06:01.284172 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f80bbab5-ebca-49db-ac0b-677711be8388 None admin] SCRIPT_NAME: `/identity` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:06:01.284446 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f80bbab5-ebca-49db-ac0b-677711be8388 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:06:01.296477 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f80bbab5-ebca-49db-ac0b-677711be8388 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 17 19:06:01.301708 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application [None req-f80bbab5-ebca-49db-ac0b-677711be8388 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 17 19:06:01.301708 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 19:06:01.301708 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 19:06:01.301708 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 19:06:01.301708 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 19:06:01.301708 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 19:06:01.301708 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 19:06:01.301708 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 19:06:01.301708 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 19:06:01.301708 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 19:06:01.301708 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 19:06:01.301708 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 19:06:01.301708 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 17 19:06:01.301708 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 17 19:06:01.301708 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 17 19:06:01.301708 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 17 19:06:01.302701 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 17 19:06:01.302701 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 17 19:06:01.302701 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 17 19:06:01.302701 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 17 19:06:01.302701 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 19:06:01.302701 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 19:06:01.302701 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 19:06:01.302701 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 19:06:01.302701 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 19:06:01.302701 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 19:06:01.302701 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 19:06:01.302701 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application with Lock( Aug 17 19:06:01.302701 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 19:06:01.302701 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application return self._enter() Aug 17 19:06:01.302701 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 19:06:01.302701 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 19:06:01.303591 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 19:06:01.303591 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application return self.creator() Aug 17 19:06:01.303591 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 19:06:01.303591 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application created_value = creator( Aug 17 19:06:01.303591 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 17 19:06:01.303591 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 17 19:06:01.303591 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 17 19:06:01.303591 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 17 19:06:01.303591 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 17 19:06:01.303591 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 17 19:06:01.303591 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 17 19:06:01.303591 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application Aug 17 19:06:01.303591 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: [pid: 88551|app: 0|req: 167/346] 10.222.0.26 () {56 vars in 1099 bytes} [Wed Aug 17 19:06:01 2022] GET /identity/v3/roles/reader => generated 84 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 19:06:01.304286 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f80bbab5-ebca-49db-ac0b-677711be8388 None admin] Authenticating user token {{(pid=88551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:06:01.327734 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG dbcounter [-] [88550] Writing DB stats keystone:SELECT=100 {{(pid=88550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:06:01.330916 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG dbcounter [-] [88551] Writing DB stats keystone:SELECT=100 {{(pid=88551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:06:01.417735 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f80bbab5-ebca-49db-ac0b-677711be8388 None admin] Validating token access rules against request {{(pid=88551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:06:01.462433 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9a1a140-c87a-4e93-b888-4303c5d88eb9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '819d41a279e64291acc60de51e1530ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:06:01.463291 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a1a140-c87a-4e93-b888-4303c5d88eb9 None admin] REQUEST_METHOD: `GET` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:06:01.463580 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a1a140-c87a-4e93-b888-4303c5d88eb9 None admin] SCRIPT_NAME: `/identity` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:06:01.463862 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a1a140-c87a-4e93-b888-4303c5d88eb9 None admin] PATH_INFO: `/v3/roles` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:06:01.464712 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9a1a140-c87a-4e93-b888-4303c5d88eb9 None admin] RBAC: Adding query filter params (name=member) {{(pid=88551) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 19:06:01.465366 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9a1a140-c87a-4e93-b888-4303c5d88eb9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:06:01.468752 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9a1a140-c87a-4e93-b888-4303c5d88eb9 None admin] RBAC: Authorization granted {{(pid=88551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:06:01.479080 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: [pid: 88551|app: 0|req: 168/347] 10.222.0.26 () {56 vars in 1101 bytes} [Wed Aug 17 19:06:01 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 19:06:01.479925 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9a1a140-c87a-4e93-b888-4303c5d88eb9 None admin] Authenticating user token {{(pid=88551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:06:01.481005 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f143184e-ac3d-43a7-b8c0-dd93e0cbac18 None admin] Validating token access rules against request {{(pid=88550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:06:01.527693 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f18ddba5-9418-440c-803f-f2c3cb78663d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '819d41a279e64291acc60de51e1530ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:06:01.528321 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f18ddba5-9418-440c-803f-f2c3cb78663d None admin] REQUEST_METHOD: `GET` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:06:01.529222 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f18ddba5-9418-440c-803f-f2c3cb78663d None admin] SCRIPT_NAME: `/identity` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:06:01.529512 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f18ddba5-9418-440c-803f-f2c3cb78663d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:06:01.610769 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9a1a140-c87a-4e93-b888-4303c5d88eb9 None admin] Validating token access rules against request {{(pid=88551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:06:01.619871 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f18ddba5-9418-440c-803f-f2c3cb78663d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:06:01.621358 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f18ddba5-9418-440c-803f-f2c3cb78663d None admin] RBAC: Authorization granted {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:06:01.626526 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG dbcounter [-] [88551] Writing DB stats keystone:SELECT=100 {{(pid=88551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:06:01.660138 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG dbcounter [-] [88550] Writing DB stats keystone:SELECT=100 {{(pid=88550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:06:01.661844 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbb23946-8d3b-48f3-8bd1-95d03cd6ba36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '819d41a279e64291acc60de51e1530ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:06:01.662470 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb23946-8d3b-48f3-8bd1-95d03cd6ba36 None admin] REQUEST_METHOD: `GET` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:06:01.662789 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb23946-8d3b-48f3-8bd1-95d03cd6ba36 None admin] SCRIPT_NAME: `/identity` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:06:01.663065 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb23946-8d3b-48f3-8bd1-95d03cd6ba36 None admin] PATH_INFO: `/v3/roles` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:06:01.663757 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbb23946-8d3b-48f3-8bd1-95d03cd6ba36 None admin] RBAC: Adding query filter params (name=reader) {{(pid=88551) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 19:06:01.664044 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbb23946-8d3b-48f3-8bd1-95d03cd6ba36 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:06:01.665434 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbb23946-8d3b-48f3-8bd1-95d03cd6ba36 None admin] RBAC: Authorization granted {{(pid=88551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:06:01.676818 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: [pid: 88551|app: 0|req: 169/348] 10.222.0.26 () {56 vars in 1101 bytes} [Wed Aug 17 19:06:01 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 19:06:01.683473 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbb23946-8d3b-48f3-8bd1-95d03cd6ba36 None admin] Authenticating user token {{(pid=88551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:06:01.774861 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: [pid: 88550|app: 0|req: 180/349] 10.222.0.26 () {58 vars in 1282 bytes} [Wed Aug 17 19:06:01 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 513 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 17 19:06:01.776498 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f18ddba5-9418-440c-803f-f2c3cb78663d None admin] Authenticating user token {{(pid=88550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:06:01.810660 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbb23946-8d3b-48f3-8bd1-95d03cd6ba36 None admin] Validating token access rules against request {{(pid=88551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:06:01.862369 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8888f59b-ac7a-4e92-9106-90673c4c52b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '819d41a279e64291acc60de51e1530ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:06:01.862976 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8888f59b-ac7a-4e92-9106-90673c4c52b7 None admin] REQUEST_METHOD: `GET` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:06:01.863255 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8888f59b-ac7a-4e92-9106-90673c4c52b7 None admin] SCRIPT_NAME: `/identity` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:06:01.863521 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8888f59b-ac7a-4e92-9106-90673c4c52b7 None admin] PATH_INFO: `/v3/roles/member` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:06:01.877798 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8888f59b-ac7a-4e92-9106-90673c4c52b7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 17 19:06:01.884044 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application [None req-8888f59b-ac7a-4e92-9106-90673c4c52b7 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 17 19:06:01.884044 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 19:06:01.884044 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 19:06:01.884044 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 19:06:01.884044 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 19:06:01.884044 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 19:06:01.884044 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 19:06:01.884044 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 19:06:01.884044 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 19:06:01.884044 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 19:06:01.884044 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 19:06:01.884044 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 19:06:01.884044 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 17 19:06:01.884044 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 17 19:06:01.884044 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 17 19:06:01.884044 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 17 19:06:01.885426 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 17 19:06:01.885426 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 17 19:06:01.885426 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 17 19:06:01.885426 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 17 19:06:01.885426 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 19:06:01.885426 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 19:06:01.885426 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 19:06:01.885426 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 19:06:01.885426 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 19:06:01.885426 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 19:06:01.885426 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 19:06:01.885426 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application with Lock( Aug 17 19:06:01.885426 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 19:06:01.885426 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application return self._enter() Aug 17 19:06:01.885426 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 19:06:01.885426 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 19:06:01.886931 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 19:06:01.886931 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application return self.creator() Aug 17 19:06:01.886931 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 19:06:01.886931 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application created_value = creator( Aug 17 19:06:01.886931 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 17 19:06:01.886931 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 17 19:06:01.886931 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 17 19:06:01.886931 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 17 19:06:01.886931 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 17 19:06:01.886931 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 17 19:06:01.886931 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 17 19:06:01.886931 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application Aug 17 19:06:01.886931 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: [pid: 88551|app: 0|req: 170/350] 10.222.0.26 () {56 vars in 1099 bytes} [Wed Aug 17 19:06:01 2022] GET /identity/v3/roles/member => generated 84 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 19:06:01.886931 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8888f59b-ac7a-4e92-9106-90673c4c52b7 None admin] Authenticating user token {{(pid=88551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:06:01.889267 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG dbcounter [-] [88551] Writing DB stats keystone:SELECT=100 {{(pid=88551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:06:01.924732 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f18ddba5-9418-440c-803f-f2c3cb78663d None admin] Validating token access rules against request {{(pid=88550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:06:01.956107 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG dbcounter [-] [88550] Writing DB stats keystone:SELECT=100 {{(pid=88550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:06:01.969050 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be9f0e13-b94b-4191-a9ea-630e50dfa3cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '819d41a279e64291acc60de51e1530ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:06:01.969668 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be9f0e13-b94b-4191-a9ea-630e50dfa3cd None admin] REQUEST_METHOD: `GET` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:06:01.970657 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be9f0e13-b94b-4191-a9ea-630e50dfa3cd None admin] SCRIPT_NAME: `/identity` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:06:01.970657 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be9f0e13-b94b-4191-a9ea-630e50dfa3cd None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:06:02.034732 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8888f59b-ac7a-4e92-9106-90673c4c52b7 None admin] Validating token access rules against request {{(pid=88551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:06:02.056741 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be9f0e13-b94b-4191-a9ea-630e50dfa3cd None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:06:02.059369 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be9f0e13-b94b-4191-a9ea-630e50dfa3cd None admin] RBAC: Authorization granted {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:06:02.088129 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3897758-1136-4bfb-b753-3aaf37d4d0e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '819d41a279e64291acc60de51e1530ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:06:02.090314 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3897758-1136-4bfb-b753-3aaf37d4d0e8 None admin] REQUEST_METHOD: `GET` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:06:02.090314 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3897758-1136-4bfb-b753-3aaf37d4d0e8 None admin] SCRIPT_NAME: `/identity` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:06:02.090314 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3897758-1136-4bfb-b753-3aaf37d4d0e8 None admin] PATH_INFO: `/v3/users/d3c3cbc565214959bfce57d44a8dc244` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:06:02.094893 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3897758-1136-4bfb-b753-3aaf37d4d0e8 None admin] RBAC: Authorizing `identity:get_user(user_id=d3c3cbc565214959bfce57d44a8dc244)` {{(pid=88551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:06:02.096354 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3897758-1136-4bfb-b753-3aaf37d4d0e8 None admin] RBAC: Authorization granted {{(pid=88551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:06:02.099025 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: [pid: 88551|app: 0|req: 171/351] 10.222.0.26 () {56 vars in 1177 bytes} [Wed Aug 17 19:06:01 2022] GET /identity/v3/users/d3c3cbc565214959bfce57d44a8dc244 => generated 293 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 19:06:02.101529 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce8b9dcb-23b5-480b-ade6-6b30b2f771bc None None] REQUEST_METHOD: `GET` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:06:02.101529 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce8b9dcb-23b5-480b-ade6-6b30b2f771bc None None] SCRIPT_NAME: `/identity` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:06:02.101852 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce8b9dcb-23b5-480b-ade6-6b30b2f771bc None None] PATH_INFO: `/` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:06:02.103370 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: [pid: 88551|app: 0|req: 172/352] 10.222.0.26 () {54 vars in 927 bytes} [Wed Aug 17 19:06:02 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 19:06:02.104103 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce8b9dcb-23b5-480b-ade6-6b30b2f771bc None None] Authenticating user token {{(pid=88551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:06:02.199275 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG dbcounter [-] [88551] Writing DB stats keystone:SELECT=100 {{(pid=88551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:06:02.204683 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: [pid: 88550|app: 0|req: 181/353] 10.222.0.26 () {58 vars in 1282 bytes} [Wed Aug 17 19:06:01 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 429 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 17 19:06:02.211814 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be9f0e13-b94b-4191-a9ea-630e50dfa3cd None admin] Authenticating user token {{(pid=88550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:06:02.245689 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG dbcounter [-] [88550] Writing DB stats keystone:SELECT=100 {{(pid=88550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:06:02.248174 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce8b9dcb-23b5-480b-ade6-6b30b2f771bc None None] Validating token access rules against request {{(pid=88551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:06:02.312801 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fee4129-fcce-4bfd-bca6-595b079de72e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '819d41a279e64291acc60de51e1530ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:06:02.313805 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fee4129-fcce-4bfd-bca6-595b079de72e None admin] REQUEST_METHOD: `GET` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:06:02.314288 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fee4129-fcce-4bfd-bca6-595b079de72e None admin] SCRIPT_NAME: `/identity` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:06:02.314854 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fee4129-fcce-4bfd-bca6-595b079de72e None admin] PATH_INFO: `/v3/projects/143eeb5624b2449582a0739926bcb8e1` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:06:02.317643 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fee4129-fcce-4bfd-bca6-595b079de72e None admin] RBAC: Authorizing `identity:get_project(project_id=143eeb5624b2449582a0739926bcb8e1)` {{(pid=88551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:06:02.319442 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fee4129-fcce-4bfd-bca6-595b079de72e None admin] RBAC: Authorization granted {{(pid=88551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:06:02.321478 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: [pid: 88551|app: 0|req: 173/354] 10.222.0.26 () {56 vars in 1186 bytes} [Wed Aug 17 19:06:02 2022] GET /identity/v3/projects/143eeb5624b2449582a0739926bcb8e1 => generated 298 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 19:06:02.323976 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fee4129-fcce-4bfd-bca6-595b079de72e None admin] Authenticating user token {{(pid=88551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:06:02.375368 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be9f0e13-b94b-4191-a9ea-630e50dfa3cd None admin] Validating token access rules against request {{(pid=88550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:06:02.446843 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb2f252f-e2c8-47ca-a15c-1b826a88dfd8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '819d41a279e64291acc60de51e1530ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:06:02.448402 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb2f252f-e2c8-47ca-a15c-1b826a88dfd8 None admin] REQUEST_METHOD: `GET` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:06:02.448402 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb2f252f-e2c8-47ca-a15c-1b826a88dfd8 None admin] SCRIPT_NAME: `/identity` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:06:02.448402 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb2f252f-e2c8-47ca-a15c-1b826a88dfd8 None admin] PATH_INFO: `/v3/roles` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:06:02.448691 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb2f252f-e2c8-47ca-a15c-1b826a88dfd8 None admin] RBAC: Adding query filter params (name=member) {{(pid=88550) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 19:06:02.448858 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb2f252f-e2c8-47ca-a15c-1b826a88dfd8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:06:02.450329 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb2f252f-e2c8-47ca-a15c-1b826a88dfd8 None admin] RBAC: Authorization granted {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:06:02.464663 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: [pid: 88550|app: 0|req: 182/355] 10.222.0.26 () {56 vars in 1101 bytes} [Wed Aug 17 19:06:02 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 259 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 19:06:02.469524 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e190142-f047-4f55-b37a-5882d6d82fc0 None None] REQUEST_METHOD: `POST` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:06:02.469524 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e190142-f047-4f55-b37a-5882d6d82fc0 None None] SCRIPT_NAME: `/identity` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:06:02.469524 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e190142-f047-4f55-b37a-5882d6d82fc0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:06:02.493872 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.auth.core [None req-3e190142-f047-4f55-b37a-5882d6d82fc0 None None] MFA Rules not processed for user `819d41a279e64291acc60de51e1530ae`. Rule list: `[]` (Enabled: `True`). {{(pid=88550) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 19:06:02.495432 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.common.fernet_utils [None req-3e190142-f047-4f55-b37a-5882d6d82fc0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:06:02.510385 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fee4129-fcce-4bfd-bca6-595b079de72e None admin] Validating token access rules against request {{(pid=88551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:06:02.570926 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03d728b1-3c60-46df-adfd-a152e215b1f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '819d41a279e64291acc60de51e1530ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:06:02.571667 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d728b1-3c60-46df-adfd-a152e215b1f9 None admin] REQUEST_METHOD: `GET` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:06:02.572021 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d728b1-3c60-46df-adfd-a152e215b1f9 None admin] SCRIPT_NAME: `/identity` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:06:02.572371 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d728b1-3c60-46df-adfd-a152e215b1f9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:06:02.573506 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03d728b1-3c60-46df-adfd-a152e215b1f9 None admin] RBAC: Adding query filter params (role.id=e46917e94e2e4018b346d95b26d804eb, user.id=d3c3cbc565214959bfce57d44a8dc244, scope.system=all) {{(pid=88551) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 19:06:02.573891 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03d728b1-3c60-46df-adfd-a152e215b1f9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:06:02.575450 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03d728b1-3c60-46df-adfd-a152e215b1f9 None admin] RBAC: Authorization granted {{(pid=88551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:06:02.581567 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG dbcounter [-] [88551] Writing DB stats keystone:SELECT=100 {{(pid=88551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:06:02.592045 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: [pid: 88551|app: 0|req: 174/356] 10.222.0.26 () {56 vars in 1308 bytes} [Wed Aug 17 19:06:02 2022] GET /identity/v3/role_assignments?user.id=d3c3cbc565214959bfce57d44a8dc244&scope.system=all&role.id=e46917e94e2e4018b346d95b26d804eb => generated 510 bytes in 268 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 19:06:02.592761 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03d728b1-3c60-46df-adfd-a152e215b1f9 None admin] Authenticating user token {{(pid=88551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:06:02.646708 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: [pid: 88550|app: 0|req: 183/357] 10.222.0.26 () {58 vars in 1024 bytes} [Wed Aug 17 19:06:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 17 19:06:02.648701 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e190142-f047-4f55-b37a-5882d6d82fc0 None None] Authenticating user token {{(pid=88550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:06:02.683671 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG dbcounter [-] [88550] Writing DB stats keystone:SELECT=100 {{(pid=88550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:06:02.771324 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03d728b1-3c60-46df-adfd-a152e215b1f9 None admin] Validating token access rules against request {{(pid=88551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:06:02.819897 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f70bfff4-567d-4da2-a791-7668a0591f35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '819d41a279e64291acc60de51e1530ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:06:02.820541 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f70bfff4-567d-4da2-a791-7668a0591f35 None admin] REQUEST_METHOD: `GET` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:06:02.820820 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f70bfff4-567d-4da2-a791-7668a0591f35 None admin] SCRIPT_NAME: `/identity` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:06:02.821098 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f70bfff4-567d-4da2-a791-7668a0591f35 None admin] PATH_INFO: `/v3/projects/4ebe56b7d67e4584afee4a218097f2b4` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:06:02.823210 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f70bfff4-567d-4da2-a791-7668a0591f35 None admin] RBAC: Authorizing `identity:get_project(project_id=4ebe56b7d67e4584afee4a218097f2b4)` {{(pid=88551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:06:02.824659 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f70bfff4-567d-4da2-a791-7668a0591f35 None admin] RBAC: Authorization granted {{(pid=88551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:06:02.825442 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e190142-f047-4f55-b37a-5882d6d82fc0 None None] Validating token access rules against request {{(pid=88550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:06:02.826308 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: [pid: 88551|app: 0|req: 175/358] 10.222.0.26 () {56 vars in 1186 bytes} [Wed Aug 17 19:06:02 2022] GET /identity/v3/projects/4ebe56b7d67e4584afee4a218097f2b4 => generated 302 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 19:06:02.828395 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f70bfff4-567d-4da2-a791-7668a0591f35 None admin] Authenticating user token {{(pid=88551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:06:02.879568 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1edbbfc5-87a3-437c-a4a5-c49f5371b563 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '819d41a279e64291acc60de51e1530ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:06:02.880220 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1edbbfc5-87a3-437c-a4a5-c49f5371b563 None admin] REQUEST_METHOD: `GET` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:06:02.880525 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1edbbfc5-87a3-437c-a4a5-c49f5371b563 None admin] SCRIPT_NAME: `/identity` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:06:02.880799 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1edbbfc5-87a3-437c-a4a5-c49f5371b563 None admin] PATH_INFO: `/v3/groups/075b91f7cf344f048495ae57f2301231` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:06:02.890088 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1edbbfc5-87a3-437c-a4a5-c49f5371b563 None admin] RBAC: Authorizing `identity:get_group(group_id=075b91f7cf344f048495ae57f2301231)` {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:06:02.891753 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1edbbfc5-87a3-437c-a4a5-c49f5371b563 None admin] RBAC: Authorization granted {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:06:02.893532 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: [pid: 88550|app: 0|req: 184/359] 10.222.0.26 () {56 vars in 1180 bytes} [Wed Aug 17 19:06:02 2022] GET /identity/v3/groups/075b91f7cf344f048495ae57f2301231 => generated 226 bytes in 245 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 19:06:02.895516 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d458b1-87be-4ff2-b558-2410c531efb7 None None] REQUEST_METHOD: `GET` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:06:02.895811 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d458b1-87be-4ff2-b558-2410c531efb7 None None] SCRIPT_NAME: `/identity` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:06:02.896190 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d458b1-87be-4ff2-b558-2410c531efb7 None None] PATH_INFO: `/` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:06:02.897570 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: [pid: 88550|app: 0|req: 185/360] 10.222.0.26 () {54 vars in 927 bytes} [Wed Aug 17 19:06:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 19:06:02.898150 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8d458b1-87be-4ff2-b558-2410c531efb7 None None] Authenticating user token {{(pid=88550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:06:02.914261 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG dbcounter [-] [88551] Writing DB stats keystone:SELECT=100 {{(pid=88551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:06:02.974248 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f70bfff4-567d-4da2-a791-7668a0591f35 None admin] Validating token access rules against request {{(pid=88551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:06:03.016746 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c850475-eb43-4370-ae16-48602f9fbd8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '819d41a279e64291acc60de51e1530ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:06:03.017479 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c850475-eb43-4370-ae16-48602f9fbd8f None admin] REQUEST_METHOD: `GET` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:06:03.017939 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c850475-eb43-4370-ae16-48602f9fbd8f None admin] SCRIPT_NAME: `/identity` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:06:03.018238 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c850475-eb43-4370-ae16-48602f9fbd8f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:06:03.020288 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG dbcounter [-] [88550] Writing DB stats keystone:SELECT=100 {{(pid=88550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:06:03.041524 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8d458b1-87be-4ff2-b558-2410c531efb7 None None] Validating token access rules against request {{(pid=88550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:06:03.082496 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d813a09-76d3-4c92-b728-d0ac2c65d237 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '819d41a279e64291acc60de51e1530ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:06:03.083163 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d813a09-76d3-4c92-b728-d0ac2c65d237 None admin] REQUEST_METHOD: `GET` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:06:03.083439 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d813a09-76d3-4c92-b728-d0ac2c65d237 None admin] SCRIPT_NAME: `/identity` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:06:03.083708 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d813a09-76d3-4c92-b728-d0ac2c65d237 None admin] PATH_INFO: `/v3/groups/075b91f7cf344f048495ae57f2301231` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:06:03.084816 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d813a09-76d3-4c92-b728-d0ac2c65d237 None admin] RBAC: Authorizing `identity:get_group(group_id=075b91f7cf344f048495ae57f2301231)` {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:06:03.086654 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d813a09-76d3-4c92-b728-d0ac2c65d237 None admin] RBAC: Authorization granted {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:06:03.088176 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: [pid: 88550|app: 0|req: 186/361] 10.222.0.26 () {56 vars in 1180 bytes} [Wed Aug 17 19:06:02 2022] GET /identity/v3/groups/075b91f7cf344f048495ae57f2301231 => generated 226 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 19:06:03.088732 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d813a09-76d3-4c92-b728-d0ac2c65d237 None admin] Authenticating user token {{(pid=88550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:06:03.106265 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c850475-eb43-4370-ae16-48602f9fbd8f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:06:03.107785 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c850475-eb43-4370-ae16-48602f9fbd8f None admin] RBAC: Authorization granted {{(pid=88551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:06:03.182751 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG dbcounter [-] [88551] Writing DB stats keystone:SELECT=100 {{(pid=88551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:06:03.204898 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d813a09-76d3-4c92-b728-d0ac2c65d237 None admin] Validating token access rules against request {{(pid=88550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:06:03.235404 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: [pid: 88551|app: 0|req: 176/362] 10.222.0.26 () {58 vars in 1282 bytes} [Wed Aug 17 19:06:02 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 408 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 17 19:06:03.236544 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14624eaa-c8e6-4add-bf94-d240297a34a2 None None] REQUEST_METHOD: `POST` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:06:03.236836 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14624eaa-c8e6-4add-bf94-d240297a34a2 None None] SCRIPT_NAME: `/identity` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:06:03.237138 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14624eaa-c8e6-4add-bf94-d240297a34a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:06:03.254939 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0d4ba13-2f83-4cce-ad72-daaebb8f86fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '819d41a279e64291acc60de51e1530ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:06:03.255912 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d4ba13-2f83-4cce-ad72-daaebb8f86fd None admin] REQUEST_METHOD: `GET` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:06:03.256348 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d4ba13-2f83-4cce-ad72-daaebb8f86fd None admin] SCRIPT_NAME: `/identity` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:06:03.256767 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d4ba13-2f83-4cce-ad72-daaebb8f86fd None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:06:03.257638 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0d4ba13-2f83-4cce-ad72-daaebb8f86fd None admin] RBAC: Adding query filter params (group.id=075b91f7cf344f048495ae57f2301231, role.id=60df6490940943d3b281ddaab1b0b9f7, scope.project.id=143eeb5624b2449582a0739926bcb8e1) {{(pid=88550) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 19:06:03.258175 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0d4ba13-2f83-4cce-ad72-daaebb8f86fd None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:06:03.260303 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.auth.core [None req-14624eaa-c8e6-4add-bf94-d240297a34a2 None None] MFA Rules not processed for user `819d41a279e64291acc60de51e1530ae`. Rule list: `[]` (Enabled: `True`). {{(pid=88551) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 19:06:03.260457 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0d4ba13-2f83-4cce-ad72-daaebb8f86fd None admin] RBAC: Authorization granted {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:06:03.260622 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.common.fernet_utils [None req-14624eaa-c8e6-4add-bf94-d240297a34a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:06:03.272869 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: [pid: 88550|app: 0|req: 187/363] 10.222.0.26 () {56 vars in 1376 bytes} [Wed Aug 17 19:06:03 2022] GET /identity/v3/role_assignments?group.id=075b91f7cf344f048495ae57f2301231&scope.project.id=143eeb5624b2449582a0739926bcb8e1&role.id=60df6490940943d3b281ddaab1b0b9f7 => generated 260 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 19:06:03.272869 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0d4ba13-2f83-4cce-ad72-daaebb8f86fd None admin] Authenticating user token {{(pid=88550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:06:03.294206 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG dbcounter [-] [88550] Writing DB stats keystone:SELECT=100 {{(pid=88550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:06:03.354728 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: [pid: 88551|app: 0|req: 177/364] 10.222.0.26 () {58 vars in 1024 bytes} [Wed Aug 17 19:06:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 17 19:06:03.355823 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14624eaa-c8e6-4add-bf94-d240297a34a2 None None] Authenticating user token {{(pid=88551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:06:03.403598 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0d4ba13-2f83-4cce-ad72-daaebb8f86fd None admin] Validating token access rules against request {{(pid=88550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:06:03.442070 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5934cf2-5e8a-4cf4-b3a8-62f28ae78308 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '819d41a279e64291acc60de51e1530ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:06:03.443305 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5934cf2-5e8a-4cf4-b3a8-62f28ae78308 None admin] REQUEST_METHOD: `GET` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:06:03.443826 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5934cf2-5e8a-4cf4-b3a8-62f28ae78308 None admin] SCRIPT_NAME: `/identity` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:06:03.444404 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5934cf2-5e8a-4cf4-b3a8-62f28ae78308 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:06:03.457481 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5934cf2-5e8a-4cf4-b3a8-62f28ae78308 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 17 19:06:03.464771 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application [None req-d5934cf2-5e8a-4cf4-b3a8-62f28ae78308 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 17 19:06:03.464771 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 19:06:03.464771 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 19:06:03.464771 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 19:06:03.464771 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 19:06:03.464771 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 19:06:03.464771 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 19:06:03.464771 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 19:06:03.464771 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 19:06:03.464771 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 19:06:03.464771 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 19:06:03.464771 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 19:06:03.464771 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 17 19:06:03.464771 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 17 19:06:03.464771 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 17 19:06:03.464771 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 17 19:06:03.465723 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 17 19:06:03.465723 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 17 19:06:03.465723 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 17 19:06:03.465723 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 17 19:06:03.465723 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 19:06:03.465723 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 19:06:03.465723 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 19:06:03.465723 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 19:06:03.465723 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 19:06:03.465723 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 19:06:03.465723 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 19:06:03.465723 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application with Lock( Aug 17 19:06:03.465723 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 19:06:03.465723 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return self._enter() Aug 17 19:06:03.465723 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 19:06:03.465723 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 19:06:03.466576 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 19:06:03.466576 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return self.creator() Aug 17 19:06:03.466576 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 19:06:03.466576 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application created_value = creator( Aug 17 19:06:03.466576 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 17 19:06:03.466576 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 17 19:06:03.466576 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 17 19:06:03.466576 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 17 19:06:03.466576 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 17 19:06:03.466576 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 17 19:06:03.466576 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 17 19:06:03.466576 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application Aug 17 19:06:03.469370 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: [pid: 88550|app: 0|req: 188/365] 10.222.0.26 () {56 vars in 1114 bytes} [Wed Aug 17 19:06:03 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 19:06:03.470423 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5934cf2-5e8a-4cf4-b3a8-62f28ae78308 None admin] Authenticating user token {{(pid=88550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:06:03.480392 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG dbcounter [-] [88551] Writing DB stats keystone:SELECT=100 {{(pid=88551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:06:03.488608 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14624eaa-c8e6-4add-bf94-d240297a34a2 None None] Validating token access rules against request {{(pid=88551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:06:03.531756 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88493e1b-09c3-47aa-b8ef-23ff999ef767 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '819d41a279e64291acc60de51e1530ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:06:03.532641 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88493e1b-09c3-47aa-b8ef-23ff999ef767 None admin] REQUEST_METHOD: `GET` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:06:03.532918 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88493e1b-09c3-47aa-b8ef-23ff999ef767 None admin] SCRIPT_NAME: `/identity` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:06:03.533185 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88493e1b-09c3-47aa-b8ef-23ff999ef767 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:06:03.534077 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88493e1b-09c3-47aa-b8ef-23ff999ef767 None admin] RBAC: Adding query filter params (group.id=075b91f7cf344f048495ae57f2301231, role.id=748773430faa4030989e1e77b3f361e1, scope.project.id=4ebe56b7d67e4584afee4a218097f2b4) {{(pid=88551) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 19:06:03.534385 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88493e1b-09c3-47aa-b8ef-23ff999ef767 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:06:03.536630 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88493e1b-09c3-47aa-b8ef-23ff999ef767 None admin] RBAC: Authorization granted {{(pid=88551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:06:03.544927 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: [pid: 88551|app: 0|req: 178/366] 10.222.0.26 () {56 vars in 1376 bytes} [Wed Aug 17 19:06:03 2022] GET /identity/v3/role_assignments?group.id=075b91f7cf344f048495ae57f2301231&scope.project.id=4ebe56b7d67e4584afee4a218097f2b4&role.id=748773430faa4030989e1e77b3f361e1 => generated 260 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 19:06:03.545791 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88493e1b-09c3-47aa-b8ef-23ff999ef767 None admin] Authenticating user token {{(pid=88551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:06:03.568832 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG dbcounter [-] [88550] Writing DB stats keystone:SELECT=100 {{(pid=88550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:06:03.602739 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5934cf2-5e8a-4cf4-b3a8-62f28ae78308 None admin] Validating token access rules against request {{(pid=88550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:06:03.663525 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79d99088-7057-4b1c-a511-db31b54e404b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '819d41a279e64291acc60de51e1530ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:06:03.664184 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d99088-7057-4b1c-a511-db31b54e404b None admin] REQUEST_METHOD: `GET` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:06:03.664463 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d99088-7057-4b1c-a511-db31b54e404b None admin] SCRIPT_NAME: `/identity` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:06:03.664734 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d99088-7057-4b1c-a511-db31b54e404b None admin] PATH_INFO: `/v3/projects/143eeb5624b2449582a0739926bcb8e1` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:06:03.665925 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79d99088-7057-4b1c-a511-db31b54e404b None admin] RBAC: Authorizing `identity:get_project(project_id=143eeb5624b2449582a0739926bcb8e1)` {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:06:03.667416 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79d99088-7057-4b1c-a511-db31b54e404b None admin] RBAC: Authorization granted {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:06:03.669288 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: [pid: 88550|app: 0|req: 189/367] 10.222.0.26 () {56 vars in 1186 bytes} [Wed Aug 17 19:06:03 2022] GET /identity/v3/projects/143eeb5624b2449582a0739926bcb8e1 => generated 298 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 19:06:03.675776 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79d99088-7057-4b1c-a511-db31b54e404b None admin] Authenticating user token {{(pid=88550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:06:03.731571 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88493e1b-09c3-47aa-b8ef-23ff999ef767 None admin] Validating token access rules against request {{(pid=88551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:06:03.790180 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcda3908-23b1-484e-9c94-f26f96265123 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '819d41a279e64291acc60de51e1530ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:06:03.791346 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcda3908-23b1-484e-9c94-f26f96265123 None admin] REQUEST_METHOD: `GET` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:06:03.791835 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcda3908-23b1-484e-9c94-f26f96265123 None admin] SCRIPT_NAME: `/identity` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:06:03.792452 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcda3908-23b1-484e-9c94-f26f96265123 None admin] PATH_INFO: `/v3/roles` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:06:03.793493 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcda3908-23b1-484e-9c94-f26f96265123 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=88551) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 19:06:03.793998 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcda3908-23b1-484e-9c94-f26f96265123 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:06:03.797796 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcda3908-23b1-484e-9c94-f26f96265123 None admin] RBAC: Authorization granted {{(pid=88551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:06:03.810969 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: [pid: 88551|app: 0|req: 179/368] 10.222.0.26 () {56 vars in 1111 bytes} [Wed Aug 17 19:06:03 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 265 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 19:06:03.814665 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79d99088-7057-4b1c-a511-db31b54e404b None admin] Validating token access rules against request {{(pid=88550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:06:03.817010 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcda3908-23b1-484e-9c94-f26f96265123 None admin] Authenticating user token {{(pid=88551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:06:03.853475 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG dbcounter [-] [88551] Writing DB stats keystone:SELECT=100 {{(pid=88551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:06:03.858588 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43457e29-ef6b-49d0-9e7c-bf216f90f829 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '819d41a279e64291acc60de51e1530ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:06:03.859312 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43457e29-ef6b-49d0-9e7c-bf216f90f829 None admin] REQUEST_METHOD: `GET` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:06:03.859742 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43457e29-ef6b-49d0-9e7c-bf216f90f829 None admin] SCRIPT_NAME: `/identity` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:06:03.860101 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43457e29-ef6b-49d0-9e7c-bf216f90f829 None admin] PATH_INFO: `/v3/groups/075b91f7cf344f048495ae57f2301231` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:06:03.861294 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43457e29-ef6b-49d0-9e7c-bf216f90f829 None admin] RBAC: Authorizing `identity:get_group(group_id=075b91f7cf344f048495ae57f2301231)` {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:06:03.864044 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43457e29-ef6b-49d0-9e7c-bf216f90f829 None admin] RBAC: Authorization granted {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:06:03.875317 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: [pid: 88550|app: 0|req: 190/369] 10.222.0.26 () {56 vars in 1180 bytes} [Wed Aug 17 19:06:03 2022] GET /identity/v3/groups/075b91f7cf344f048495ae57f2301231 => generated 226 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 19:06:03.879277 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43457e29-ef6b-49d0-9e7c-bf216f90f829 None admin] Authenticating user token {{(pid=88550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:06:03.889621 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG dbcounter [-] [88550] Writing DB stats keystone:SELECT=100 {{(pid=88550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:06:03.965064 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcda3908-23b1-484e-9c94-f26f96265123 None admin] Validating token access rules against request {{(pid=88551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:06:04.003074 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43457e29-ef6b-49d0-9e7c-bf216f90f829 None admin] Validating token access rules against request {{(pid=88550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:06:04.004638 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-408301a9-37cc-4b8f-8124-fe671af9a42d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '819d41a279e64291acc60de51e1530ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:06:04.005437 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-408301a9-37cc-4b8f-8124-fe671af9a42d None admin] REQUEST_METHOD: `GET` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:06:04.005887 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-408301a9-37cc-4b8f-8124-fe671af9a42d None admin] SCRIPT_NAME: `/identity` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:06:04.006331 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-408301a9-37cc-4b8f-8124-fe671af9a42d None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:06:04.018436 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-408301a9-37cc-4b8f-8124-fe671af9a42d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 17 19:06:04.023476 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application [None req-408301a9-37cc-4b8f-8124-fe671af9a42d None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 17 19:06:04.023476 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 19:06:04.023476 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 19:06:04.023476 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 19:06:04.023476 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 19:06:04.023476 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 19:06:04.023476 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 19:06:04.023476 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 19:06:04.023476 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 19:06:04.023476 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 19:06:04.023476 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 19:06:04.023476 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 19:06:04.023476 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 17 19:06:04.023476 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 17 19:06:04.023476 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 17 19:06:04.023476 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 17 19:06:04.024516 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 17 19:06:04.024516 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 17 19:06:04.024516 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 17 19:06:04.024516 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 17 19:06:04.024516 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 19:06:04.024516 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 19:06:04.024516 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 19:06:04.024516 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 19:06:04.024516 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 19:06:04.024516 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 19:06:04.024516 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 19:06:04.024516 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application with Lock( Aug 17 19:06:04.024516 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 19:06:04.024516 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application return self._enter() Aug 17 19:06:04.024516 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 19:06:04.024516 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 19:06:04.025523 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 19:06:04.025523 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application return self.creator() Aug 17 19:06:04.025523 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 19:06:04.025523 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application created_value = creator( Aug 17 19:06:04.025523 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 17 19:06:04.025523 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 17 19:06:04.025523 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 17 19:06:04.025523 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 17 19:06:04.025523 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 17 19:06:04.025523 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 17 19:06:04.025523 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 17 19:06:04.025523 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application Aug 17 19:06:04.027644 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: [pid: 88551|app: 0|req: 180/370] 10.222.0.26 () {56 vars in 1096 bytes} [Wed Aug 17 19:06:03 2022] GET /identity/v3/roles/admin => generated 83 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 19:06:04.028555 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-408301a9-37cc-4b8f-8124-fe671af9a42d None admin] Authenticating user token {{(pid=88551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:06:04.054973 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8680430f-695b-4652-88e9-16d45d2d80db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '819d41a279e64291acc60de51e1530ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:06:04.055488 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8680430f-695b-4652-88e9-16d45d2d80db None admin] REQUEST_METHOD: `GET` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:06:04.055779 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8680430f-695b-4652-88e9-16d45d2d80db None admin] SCRIPT_NAME: `/identity` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:06:04.056050 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8680430f-695b-4652-88e9-16d45d2d80db None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:06:04.134905 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG dbcounter [-] [88551] Writing DB stats keystone:SELECT=100 {{(pid=88551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:06:04.161377 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-408301a9-37cc-4b8f-8124-fe671af9a42d None admin] Validating token access rules against request {{(pid=88551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:06:04.162742 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8680430f-695b-4652-88e9-16d45d2d80db None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:06:04.164380 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8680430f-695b-4652-88e9-16d45d2d80db None admin] RBAC: Authorization granted {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:06:04.178415 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG dbcounter [-] [88550] Writing DB stats keystone:SELECT=100 {{(pid=88550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:06:04.207043 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b229b7cc-9c6c-47c4-965d-d4e4ef326832 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '819d41a279e64291acc60de51e1530ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:06:04.207659 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b229b7cc-9c6c-47c4-965d-d4e4ef326832 None admin] REQUEST_METHOD: `GET` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:06:04.207936 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b229b7cc-9c6c-47c4-965d-d4e4ef326832 None admin] SCRIPT_NAME: `/identity` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:06:04.208206 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b229b7cc-9c6c-47c4-965d-d4e4ef326832 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:06:04.208946 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b229b7cc-9c6c-47c4-965d-d4e4ef326832 None admin] RBAC: Adding query filter params (group.id=075b91f7cf344f048495ae57f2301231, role.id=748773430faa4030989e1e77b3f361e1, scope.project.id=143eeb5624b2449582a0739926bcb8e1) {{(pid=88551) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 19:06:04.209315 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b229b7cc-9c6c-47c4-965d-d4e4ef326832 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:06:04.211445 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b229b7cc-9c6c-47c4-965d-d4e4ef326832 None admin] RBAC: Authorization granted {{(pid=88551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:06:04.219006 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: [pid: 88551|app: 0|req: 181/371] 10.222.0.26 () {56 vars in 1376 bytes} [Wed Aug 17 19:06:04 2022] GET /identity/v3/role_assignments?group.id=075b91f7cf344f048495ae57f2301231&scope.project.id=143eeb5624b2449582a0739926bcb8e1&role.id=748773430faa4030989e1e77b3f361e1 => generated 260 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 19:06:04.219635 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b229b7cc-9c6c-47c4-965d-d4e4ef326832 None admin] Authenticating user token {{(pid=88551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:06:04.355965 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: [pid: 88550|app: 0|req: 191/372] 10.222.0.26 () {58 vars in 1282 bytes} [Wed Aug 17 19:06:03 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 480 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 17 19:06:04.363818 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8680430f-695b-4652-88e9-16d45d2d80db None admin] Authenticating user token {{(pid=88550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:06:04.442688 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b229b7cc-9c6c-47c4-965d-d4e4ef326832 None admin] Validating token access rules against request {{(pid=88551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:06:04.488663 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12d73e91-9bfd-4525-8806-ea763e4bb184 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '819d41a279e64291acc60de51e1530ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:06:04.489296 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d73e91-9bfd-4525-8806-ea763e4bb184 None admin] REQUEST_METHOD: `GET` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:06:04.489585 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d73e91-9bfd-4525-8806-ea763e4bb184 None admin] SCRIPT_NAME: `/identity` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:06:04.490363 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d73e91-9bfd-4525-8806-ea763e4bb184 None admin] PATH_INFO: `/v3/roles` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:06:04.495940 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12d73e91-9bfd-4525-8806-ea763e4bb184 None admin] RBAC: Adding query filter params (name=admin) {{(pid=88551) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 19:06:04.496251 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12d73e91-9bfd-4525-8806-ea763e4bb184 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:06:04.497656 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12d73e91-9bfd-4525-8806-ea763e4bb184 None admin] RBAC: Authorization granted {{(pid=88551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:06:04.516788 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: [pid: 88551|app: 0|req: 182/373] 10.222.0.26 () {56 vars in 1099 bytes} [Wed Aug 17 19:06:04 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 297 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 19:06:04.523866 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12d73e91-9bfd-4525-8806-ea763e4bb184 None admin] Authenticating user token {{(pid=88551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:06:04.538226 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG dbcounter [-] [88551] Writing DB stats keystone:SELECT=100 {{(pid=88551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:06:04.544640 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8680430f-695b-4652-88e9-16d45d2d80db None admin] Validating token access rules against request {{(pid=88550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:06:04.565690 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG dbcounter [-] [88550] Writing DB stats keystone:SELECT=100 {{(pid=88550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:06:04.595082 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e11b59f0-3ea2-45a6-99f9-a67b53775088 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '819d41a279e64291acc60de51e1530ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:06:04.595723 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e11b59f0-3ea2-45a6-99f9-a67b53775088 None admin] REQUEST_METHOD: `GET` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:06:04.596002 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e11b59f0-3ea2-45a6-99f9-a67b53775088 None admin] SCRIPT_NAME: `/identity` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:06:04.596273 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e11b59f0-3ea2-45a6-99f9-a67b53775088 None admin] PATH_INFO: `/v3/projects/4ebe56b7d67e4584afee4a218097f2b4` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:06:04.597447 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e11b59f0-3ea2-45a6-99f9-a67b53775088 None admin] RBAC: Authorizing `identity:get_project(project_id=4ebe56b7d67e4584afee4a218097f2b4)` {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:06:04.600840 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e11b59f0-3ea2-45a6-99f9-a67b53775088 None admin] RBAC: Authorization granted {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:06:04.602891 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: [pid: 88550|app: 0|req: 192/374] 10.222.0.26 () {56 vars in 1186 bytes} [Wed Aug 17 19:06:04 2022] GET /identity/v3/projects/4ebe56b7d67e4584afee4a218097f2b4 => generated 302 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 17 19:06:04.608569 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e11b59f0-3ea2-45a6-99f9-a67b53775088 None admin] Authenticating user token {{(pid=88550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:06:04.718427 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12d73e91-9bfd-4525-8806-ea763e4bb184 None admin] Validating token access rules against request {{(pid=88551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:06:04.768562 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0c82a7c-0a60-4b04-a657-271816c0910f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '819d41a279e64291acc60de51e1530ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:06:04.769451 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c82a7c-0a60-4b04-a657-271816c0910f None admin] REQUEST_METHOD: `GET` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:06:04.769736 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c82a7c-0a60-4b04-a657-271816c0910f None admin] SCRIPT_NAME: `/identity` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:06:04.770257 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c82a7c-0a60-4b04-a657-271816c0910f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:06:04.795411 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e11b59f0-3ea2-45a6-99f9-a67b53775088 None admin] Validating token access rules against request {{(pid=88550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:06:04.842011 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2488f93-ad09-4879-abcb-9dd25e71ed3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '819d41a279e64291acc60de51e1530ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:06:04.843454 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2488f93-ad09-4879-abcb-9dd25e71ed3a None admin] REQUEST_METHOD: `GET` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:06:04.843876 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2488f93-ad09-4879-abcb-9dd25e71ed3a None admin] SCRIPT_NAME: `/identity` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:06:04.844318 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2488f93-ad09-4879-abcb-9dd25e71ed3a None admin] PATH_INFO: `/v3/groups/075b91f7cf344f048495ae57f2301231` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:06:04.845600 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2488f93-ad09-4879-abcb-9dd25e71ed3a None admin] RBAC: Authorizing `identity:get_group(group_id=075b91f7cf344f048495ae57f2301231)` {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:06:04.847205 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2488f93-ad09-4879-abcb-9dd25e71ed3a None admin] RBAC: Authorization granted {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:06:04.848764 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: [pid: 88550|app: 0|req: 193/375] 10.222.0.26 () {56 vars in 1180 bytes} [Wed Aug 17 19:06:04 2022] GET /identity/v3/groups/075b91f7cf344f048495ae57f2301231 => generated 226 bytes in 241 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 19:06:04.854409 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2488f93-ad09-4879-abcb-9dd25e71ed3a None admin] Authenticating user token {{(pid=88550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:06:04.866139 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0c82a7c-0a60-4b04-a657-271816c0910f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:06:04.868386 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0c82a7c-0a60-4b04-a657-271816c0910f None admin] RBAC: Authorization granted {{(pid=88551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:06:04.880165 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG dbcounter [-] [88551] Writing DB stats keystone:SELECT=100 {{(pid=88551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:06:04.907677 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG dbcounter [-] [88550] Writing DB stats keystone:SELECT=100 {{(pid=88550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:06:05.010413 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2488f93-ad09-4879-abcb-9dd25e71ed3a None admin] Validating token access rules against request {{(pid=88550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:06:05.014194 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: [pid: 88551|app: 0|req: 183/376] 10.222.0.26 () {58 vars in 1282 bytes} [Wed Aug 17 19:06:04 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 490 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 17 19:06:05.019220 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0c82a7c-0a60-4b04-a657-271816c0910f None admin] Authenticating user token {{(pid=88551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:06:05.050591 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98269b23-b788-421c-a838-af2aac665170 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '819d41a279e64291acc60de51e1530ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:06:05.051190 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98269b23-b788-421c-a838-af2aac665170 None admin] REQUEST_METHOD: `GET` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:06:05.051470 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98269b23-b788-421c-a838-af2aac665170 None admin] SCRIPT_NAME: `/identity` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:06:05.051746 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98269b23-b788-421c-a838-af2aac665170 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:06:05.052469 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98269b23-b788-421c-a838-af2aac665170 None admin] RBAC: Adding query filter params (group.id=075b91f7cf344f048495ae57f2301231, role.id=60df6490940943d3b281ddaab1b0b9f7, scope.project.id=4ebe56b7d67e4584afee4a218097f2b4) {{(pid=88550) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 19:06:05.052779 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98269b23-b788-421c-a838-af2aac665170 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:06:05.054307 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98269b23-b788-421c-a838-af2aac665170 None admin] RBAC: Authorization granted {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:06:05.060813 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: [pid: 88550|app: 0|req: 194/377] 10.222.0.26 () {56 vars in 1376 bytes} [Wed Aug 17 19:06:04 2022] GET /identity/v3/role_assignments?group.id=075b91f7cf344f048495ae57f2301231&scope.project.id=4ebe56b7d67e4584afee4a218097f2b4&role.id=60df6490940943d3b281ddaab1b0b9f7 => generated 260 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 17 19:06:05.153753 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0c82a7c-0a60-4b04-a657-271816c0910f None admin] Validating token access rules against request {{(pid=88551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:06:05.162531 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG dbcounter [-] [88551] Writing DB stats keystone:SELECT=100 {{(pid=88551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:06:05.195529 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58f56cc7-91e1-4ce2-96b0-87ffd65cdfd7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '819d41a279e64291acc60de51e1530ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:06:05.196186 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f56cc7-91e1-4ce2-96b0-87ffd65cdfd7 None admin] REQUEST_METHOD: `GET` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:06:05.196468 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f56cc7-91e1-4ce2-96b0-87ffd65cdfd7 None admin] SCRIPT_NAME: `/identity` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:06:05.196743 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f56cc7-91e1-4ce2-96b0-87ffd65cdfd7 None admin] PATH_INFO: `/v3/projects/d0490e0db9a14e81a7ea7b108a7ad6a0` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:06:05.197984 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58f56cc7-91e1-4ce2-96b0-87ffd65cdfd7 None admin] RBAC: Authorizing `identity:get_project(project_id=d0490e0db9a14e81a7ea7b108a7ad6a0)` {{(pid=88551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:06:05.199741 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58f56cc7-91e1-4ce2-96b0-87ffd65cdfd7 None admin] RBAC: Authorization granted {{(pid=88551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:06:05.201999 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: [pid: 88551|app: 0|req: 184/378] 10.222.0.26 () {56 vars in 1186 bytes} [Wed Aug 17 19:06:05 2022] GET /identity/v3/projects/d0490e0db9a14e81a7ea7b108a7ad6a0 => generated 344 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 17 19:06:05.207216 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98269b23-b788-421c-a838-af2aac665170 None admin] Authenticating user token {{(pid=88550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:06:05.321040 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98269b23-b788-421c-a838-af2aac665170 None admin] Validating token access rules against request {{(pid=88550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:06:05.330961 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG dbcounter [-] [88550] Writing DB stats keystone:SELECT=100 {{(pid=88550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:06:05.356245 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81ae109a-c3da-4f56-a20c-d8745f747b8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '819d41a279e64291acc60de51e1530ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:06:05.356941 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ae109a-c3da-4f56-a20c-d8745f747b8f None admin] REQUEST_METHOD: `GET` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:06:05.357227 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ae109a-c3da-4f56-a20c-d8745f747b8f None admin] SCRIPT_NAME: `/identity` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:06:05.357503 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ae109a-c3da-4f56-a20c-d8745f747b8f None admin] PATH_INFO: `/v3/groups/16e76c6f45ec4715adcb2a632c7275e0` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:06:05.363189 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81ae109a-c3da-4f56-a20c-d8745f747b8f None admin] RBAC: Authorizing `identity:get_group(group_id=16e76c6f45ec4715adcb2a632c7275e0)` {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:06:05.364741 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81ae109a-c3da-4f56-a20c-d8745f747b8f None admin] RBAC: Authorization granted {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:06:05.366876 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: [pid: 88550|app: 0|req: 195/379] 10.222.0.26 () {56 vars in 1180 bytes} [Wed Aug 17 19:06:05 2022] GET /identity/v3/groups/16e76c6f45ec4715adcb2a632c7275e0 => generated 229 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 17 19:06:05.372579 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58f56cc7-91e1-4ce2-96b0-87ffd65cdfd7 None admin] Authenticating user token {{(pid=88551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:06:05.479389 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58f56cc7-91e1-4ce2-96b0-87ffd65cdfd7 None admin] Validating token access rules against request {{(pid=88551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:06:05.518849 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c454a4df-eee2-4045-a4c8-66a1b8a7505d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '819d41a279e64291acc60de51e1530ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:06:05.519458 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c454a4df-eee2-4045-a4c8-66a1b8a7505d None admin] REQUEST_METHOD: `GET` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:06:05.519735 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c454a4df-eee2-4045-a4c8-66a1b8a7505d None admin] SCRIPT_NAME: `/identity` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:06:05.520006 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c454a4df-eee2-4045-a4c8-66a1b8a7505d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:06:05.520800 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c454a4df-eee2-4045-a4c8-66a1b8a7505d None admin] RBAC: Adding query filter params (group.id=16e76c6f45ec4715adcb2a632c7275e0, role.id=204f62ae18174b60a2e3f5d4f28ea326, scope.project.id=d0490e0db9a14e81a7ea7b108a7ad6a0) {{(pid=88551) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 19:06:05.521108 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c454a4df-eee2-4045-a4c8-66a1b8a7505d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:06:05.522638 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c454a4df-eee2-4045-a4c8-66a1b8a7505d None admin] RBAC: Authorization granted {{(pid=88551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:06:05.528685 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: [pid: 88551|app: 0|req: 185/380] 10.222.0.26 () {56 vars in 1376 bytes} [Wed Aug 17 19:06:05 2022] GET /identity/v3/role_assignments?group.id=16e76c6f45ec4715adcb2a632c7275e0&scope.project.id=d0490e0db9a14e81a7ea7b108a7ad6a0&role.id=204f62ae18174b60a2e3f5d4f28ea326 => generated 260 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 19:06:06.304911 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f4175df-6482-43b1-8fbd-418c5e7f04eb None None] REQUEST_METHOD: `GET` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:06:06.305482 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f4175df-6482-43b1-8fbd-418c5e7f04eb None None] SCRIPT_NAME: `/identity` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:06:06.305482 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f4175df-6482-43b1-8fbd-418c5e7f04eb None None] PATH_INFO: `/` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:06:06.307069 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: [pid: 88550|app: 0|req: 196/381] 10.222.0.26 () {54 vars in 927 bytes} [Wed Aug 17 19:06:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 19:06:06.312634 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d65567-1874-4564-9da0-8c931d6f0c9d None None] REQUEST_METHOD: `POST` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:06:06.313071 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d65567-1874-4564-9da0-8c931d6f0c9d None None] SCRIPT_NAME: `/identity` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:06:06.313168 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d65567-1874-4564-9da0-8c931d6f0c9d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:06:06.343933 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.auth.core [None req-06d65567-1874-4564-9da0-8c931d6f0c9d None None] MFA Rules not processed for user `819d41a279e64291acc60de51e1530ae`. Rule list: `[]` (Enabled: `True`). {{(pid=88551) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 19:06:06.345154 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.common.fernet_utils [None req-06d65567-1874-4564-9da0-8c931d6f0c9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:06:06.389577 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG dbcounter [-] [88551] Writing DB stats keystone:SELECT=100 {{(pid=88551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:06:06.441350 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: [pid: 88551|app: 0|req: 186/382] 10.222.0.26 () {58 vars in 1024 bytes} [Wed Aug 17 19:06:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 17 19:06:06.710392 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-193f88d4-0bd8-4b3e-9d43-d0a6f6a480c5 None None] REQUEST_METHOD: `GET` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:06:06.710608 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-193f88d4-0bd8-4b3e-9d43-d0a6f6a480c5 None None] SCRIPT_NAME: `/identity` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:06:06.710873 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-193f88d4-0bd8-4b3e-9d43-d0a6f6a480c5 None None] PATH_INFO: `/` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:06:06.712469 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: [pid: 88550|app: 0|req: 197/383] 10.222.0.26 () {54 vars in 927 bytes} [Wed Aug 17 19:06:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 19:06:06.717658 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba036e3-4ced-44d9-836e-4dde9f148546 None None] REQUEST_METHOD: `POST` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:06:06.717941 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba036e3-4ced-44d9-836e-4dde9f148546 None None] SCRIPT_NAME: `/identity` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:06:06.718207 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba036e3-4ced-44d9-836e-4dde9f148546 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:06:06.743529 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.auth.core [None req-8ba036e3-4ced-44d9-836e-4dde9f148546 None None] MFA Rules not processed for user `819d41a279e64291acc60de51e1530ae`. Rule list: `[]` (Enabled: `True`). {{(pid=88551) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 19:06:06.744725 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.common.fernet_utils [None req-8ba036e3-4ced-44d9-836e-4dde9f148546 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:06:06.826573 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: [pid: 88551|app: 0|req: 187/384] 10.222.0.26 () {58 vars in 1024 bytes} [Wed Aug 17 19:06:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 17 19:06:06.938735 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-193f88d4-0bd8-4b3e-9d43-d0a6f6a480c5 None None] Authenticating user token {{(pid=88550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:06:07.077185 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-193f88d4-0bd8-4b3e-9d43-d0a6f6a480c5 None None] Validating token access rules against request {{(pid=88550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:06:07.125682 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d22c9533-5ed7-4136-a0cd-6489d8d36761 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '819d41a279e64291acc60de51e1530ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:06:07.126315 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d22c9533-5ed7-4136-a0cd-6489d8d36761 None admin] REQUEST_METHOD: `GET` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:06:07.126622 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d22c9533-5ed7-4136-a0cd-6489d8d36761 None admin] SCRIPT_NAME: `/identity` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:06:07.126987 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d22c9533-5ed7-4136-a0cd-6489d8d36761 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:06:07.141230 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d22c9533-5ed7-4136-a0cd-6489d8d36761 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 17 19:06:07.147348 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application [None req-d22c9533-5ed7-4136-a0cd-6489d8d36761 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 17 19:06:07.147348 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 19:06:07.147348 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 19:06:07.147348 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 19:06:07.147348 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 19:06:07.147348 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 19:06:07.147348 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 19:06:07.147348 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 19:06:07.147348 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 19:06:07.147348 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 19:06:07.147348 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 19:06:07.147348 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 19:06:07.147348 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 17 19:06:07.147348 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 17 19:06:07.147348 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 17 19:06:07.147348 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 17 19:06:07.148240 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 17 19:06:07.148240 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 17 19:06:07.148240 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 17 19:06:07.148240 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 17 19:06:07.148240 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 19:06:07.148240 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 19:06:07.148240 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 19:06:07.148240 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 19:06:07.148240 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 19:06:07.148240 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 19:06:07.148240 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 19:06:07.148240 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application with Lock( Aug 17 19:06:07.148240 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 19:06:07.148240 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return self._enter() Aug 17 19:06:07.148240 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 19:06:07.148240 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 19:06:07.149048 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 19:06:07.149048 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return self.creator() Aug 17 19:06:07.149048 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 19:06:07.149048 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application created_value = creator( Aug 17 19:06:07.149048 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 17 19:06:07.149048 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 17 19:06:07.149048 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 17 19:06:07.149048 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 17 19:06:07.149048 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 17 19:06:07.149048 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 17 19:06:07.149048 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 17 19:06:07.149048 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application Aug 17 19:06:07.149667 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: [pid: 88550|app: 0|req: 198/385] 10.222.0.26 () {56 vars in 1114 bytes} [Wed Aug 17 19:06:06 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 19:06:07.155384 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ba036e3-4ced-44d9-836e-4dde9f148546 None None] Authenticating user token {{(pid=88551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:06:07.267711 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5776fef1-ab14-4f87-ac35-1ef06d124839 None None] REQUEST_METHOD: `GET` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:06:07.268033 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5776fef1-ab14-4f87-ac35-1ef06d124839 None None] SCRIPT_NAME: `/identity` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:06:07.268248 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5776fef1-ab14-4f87-ac35-1ef06d124839 None None] PATH_INFO: `/` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:06:07.269643 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: [pid: 88550|app: 0|req: 199/386] 10.222.0.26 () {54 vars in 927 bytes} [Wed Aug 17 19:06:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 19:06:07.276590 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f67369eb-1c44-4f4a-a07a-1e7c37fe36b8 None None] REQUEST_METHOD: `POST` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:06:07.276909 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f67369eb-1c44-4f4a-a07a-1e7c37fe36b8 None None] SCRIPT_NAME: `/identity` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:06:07.277135 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f67369eb-1c44-4f4a-a07a-1e7c37fe36b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:06:07.290913 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG dbcounter [-] [88551] Writing DB stats keystone:SELECT=100 {{(pid=88551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:06:07.295911 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ba036e3-4ced-44d9-836e-4dde9f148546 None None] Validating token access rules against request {{(pid=88551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:06:07.303517 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.auth.core [None req-f67369eb-1c44-4f4a-a07a-1e7c37fe36b8 None None] MFA Rules not processed for user `819d41a279e64291acc60de51e1530ae`. Rule list: `[]` (Enabled: `True`). {{(pid=88550) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 19:06:07.304786 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.common.fernet_utils [None req-f67369eb-1c44-4f4a-a07a-1e7c37fe36b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:06:07.340960 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f751ca6-e6c6-42f9-8d56-d96db8e515b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '819d41a279e64291acc60de51e1530ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:06:07.341487 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f751ca6-e6c6-42f9-8d56-d96db8e515b5 None admin] REQUEST_METHOD: `GET` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:06:07.341763 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f751ca6-e6c6-42f9-8d56-d96db8e515b5 None admin] SCRIPT_NAME: `/identity` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:06:07.342039 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f751ca6-e6c6-42f9-8d56-d96db8e515b5 None admin] PATH_INFO: `/v3/roles` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:06:07.343395 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG dbcounter [-] [88550] Writing DB stats keystone:SELECT=100 {{(pid=88550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:06:07.344028 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f751ca6-e6c6-42f9-8d56-d96db8e515b5 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=88551) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 19:06:07.344028 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f751ca6-e6c6-42f9-8d56-d96db8e515b5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:06:07.345155 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f751ca6-e6c6-42f9-8d56-d96db8e515b5 None admin] RBAC: Authorization granted {{(pid=88551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:06:07.361038 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: [pid: 88551|app: 0|req: 188/387] 10.222.0.26 () {56 vars in 1111 bytes} [Wed Aug 17 19:06:07 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 19:06:07.362859 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f751ca6-e6c6-42f9-8d56-d96db8e515b5 None admin] Authenticating user token {{(pid=88551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:06:07.403130 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: [pid: 88550|app: 0|req: 200/388] 10.222.0.26 () {58 vars in 1024 bytes} [Wed Aug 17 19:06:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 17 19:06:07.404223 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f67369eb-1c44-4f4a-a07a-1e7c37fe36b8 None None] Authenticating user token {{(pid=88550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:06:07.567931 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f67369eb-1c44-4f4a-a07a-1e7c37fe36b8 None None] Validating token access rules against request {{(pid=88550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:06:07.570532 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f751ca6-e6c6-42f9-8d56-d96db8e515b5 None admin] Validating token access rules against request {{(pid=88551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:06:07.614322 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bfaab3c-0d8a-40f0-8515-64330d3256f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '819d41a279e64291acc60de51e1530ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:06:07.615335 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bfaab3c-0d8a-40f0-8515-64330d3256f9 None admin] REQUEST_METHOD: `GET` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:06:07.617596 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bfaab3c-0d8a-40f0-8515-64330d3256f9 None admin] SCRIPT_NAME: `/identity` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:06:07.618081 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bfaab3c-0d8a-40f0-8515-64330d3256f9 None admin] PATH_INFO: `/v3/groups/075b91f7cf344f048495ae57f2301231` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:06:07.620878 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bfaab3c-0d8a-40f0-8515-64330d3256f9 None admin] RBAC: Authorizing `identity:get_group(group_id=075b91f7cf344f048495ae57f2301231)` {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:06:07.625519 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bfaab3c-0d8a-40f0-8515-64330d3256f9 None admin] RBAC: Authorization granted {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:06:07.627455 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: [pid: 88550|app: 0|req: 201/389] 10.222.0.26 () {56 vars in 1180 bytes} [Wed Aug 17 19:06:07 2022] GET /identity/v3/groups/075b91f7cf344f048495ae57f2301231 => generated 226 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 19:06:07.633395 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bfaab3c-0d8a-40f0-8515-64330d3256f9 None admin] Authenticating user token {{(pid=88550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:06:07.645143 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28d4d7f5-cdfd-437c-a06a-e6880f2735ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '819d41a279e64291acc60de51e1530ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:06:07.645773 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d4d7f5-cdfd-437c-a06a-e6880f2735ab None admin] REQUEST_METHOD: `GET` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:06:07.646599 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d4d7f5-cdfd-437c-a06a-e6880f2735ab None admin] SCRIPT_NAME: `/identity` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:06:07.646885 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d4d7f5-cdfd-437c-a06a-e6880f2735ab None admin] PATH_INFO: `/v3/roles/member` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:06:07.674706 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28d4d7f5-cdfd-437c-a06a-e6880f2735ab None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 17 19:06:07.684107 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application [None req-28d4d7f5-cdfd-437c-a06a-e6880f2735ab None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 17 19:06:07.684107 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 19:06:07.684107 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 19:06:07.684107 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 19:06:07.684107 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 19:06:07.684107 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 19:06:07.684107 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 19:06:07.684107 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 19:06:07.684107 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 19:06:07.684107 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 19:06:07.684107 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 19:06:07.684107 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 19:06:07.684107 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 17 19:06:07.684107 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 17 19:06:07.684107 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 17 19:06:07.684107 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 17 19:06:07.685325 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 17 19:06:07.685325 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 17 19:06:07.685325 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 17 19:06:07.685325 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 17 19:06:07.685325 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 19:06:07.685325 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 19:06:07.685325 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 19:06:07.685325 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 19:06:07.685325 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 19:06:07.685325 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 19:06:07.685325 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 19:06:07.685325 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application with Lock( Aug 17 19:06:07.685325 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 19:06:07.685325 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application return self._enter() Aug 17 19:06:07.685325 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 19:06:07.685325 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 19:06:07.686706 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 19:06:07.686706 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application return self.creator() Aug 17 19:06:07.686706 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 19:06:07.686706 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application created_value = creator( Aug 17 19:06:07.686706 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 17 19:06:07.686706 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 17 19:06:07.686706 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 17 19:06:07.686706 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 17 19:06:07.686706 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 17 19:06:07.686706 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 17 19:06:07.686706 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 17 19:06:07.686706 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application Aug 17 19:06:07.690030 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: [pid: 88551|app: 0|req: 189/390] 10.222.0.26 () {56 vars in 1099 bytes} [Wed Aug 17 19:06:07 2022] GET /identity/v3/roles/member => generated 84 bytes in 328 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 19:06:07.697954 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28d4d7f5-cdfd-437c-a06a-e6880f2735ab None admin] Authenticating user token {{(pid=88551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:06:07.702885 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG dbcounter [-] [88550] Writing DB stats keystone:SELECT=100 {{(pid=88550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:06:07.743844 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG dbcounter [-] [88551] Writing DB stats keystone:SELECT=100 {{(pid=88551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:06:07.850068 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bfaab3c-0d8a-40f0-8515-64330d3256f9 None admin] Validating token access rules against request {{(pid=88550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:06:07.875834 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28d4d7f5-cdfd-437c-a06a-e6880f2735ab None admin] Validating token access rules against request {{(pid=88551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:06:07.887995 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d846f7d0-5fea-4907-956a-4ef66b302998 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '819d41a279e64291acc60de51e1530ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:06:07.888632 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d846f7d0-5fea-4907-956a-4ef66b302998 None admin] REQUEST_METHOD: `GET` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:06:07.888930 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d846f7d0-5fea-4907-956a-4ef66b302998 None admin] SCRIPT_NAME: `/identity` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:06:07.889209 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d846f7d0-5fea-4907-956a-4ef66b302998 None admin] PATH_INFO: `/v3/projects/143eeb5624b2449582a0739926bcb8e1` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:06:07.890359 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d846f7d0-5fea-4907-956a-4ef66b302998 None admin] RBAC: Authorizing `identity:get_project(project_id=143eeb5624b2449582a0739926bcb8e1)` {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:06:07.891838 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d846f7d0-5fea-4907-956a-4ef66b302998 None admin] RBAC: Authorization granted {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:06:07.893481 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: [pid: 88550|app: 0|req: 202/391] 10.222.0.26 () {56 vars in 1186 bytes} [Wed Aug 17 19:06:07 2022] GET /identity/v3/projects/143eeb5624b2449582a0739926bcb8e1 => generated 298 bytes in 260 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 19:06:07.898436 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d846f7d0-5fea-4907-956a-4ef66b302998 None admin] Authenticating user token {{(pid=88550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:06:07.919114 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca00558d-69a8-47d7-b09d-4d31a685e85b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '819d41a279e64291acc60de51e1530ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:06:07.919721 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca00558d-69a8-47d7-b09d-4d31a685e85b None admin] REQUEST_METHOD: `GET` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:06:07.920054 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca00558d-69a8-47d7-b09d-4d31a685e85b None admin] SCRIPT_NAME: `/identity` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:06:07.920328 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca00558d-69a8-47d7-b09d-4d31a685e85b None admin] PATH_INFO: `/v3/roles` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:06:07.921149 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca00558d-69a8-47d7-b09d-4d31a685e85b None admin] RBAC: Adding query filter params (name=member) {{(pid=88551) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 19:06:07.921365 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca00558d-69a8-47d7-b09d-4d31a685e85b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:06:07.922770 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca00558d-69a8-47d7-b09d-4d31a685e85b None admin] RBAC: Authorization granted {{(pid=88551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:06:07.941246 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: [pid: 88551|app: 0|req: 190/392] 10.222.0.26 () {56 vars in 1101 bytes} [Wed Aug 17 19:06:07 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 19:06:07.941246 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c6c31e-8976-42b2-b903-6283df61069c None None] REQUEST_METHOD: `GET` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:06:07.941246 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c6c31e-8976-42b2-b903-6283df61069c None None] SCRIPT_NAME: `/identity` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:06:07.941246 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c6c31e-8976-42b2-b903-6283df61069c None None] PATH_INFO: `/` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:06:07.941246 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: [pid: 88551|app: 0|req: 191/393] 10.222.0.26 () {54 vars in 927 bytes} [Wed Aug 17 19:06:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 19:06:07.947601 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2c6c31e-8976-42b2-b903-6283df61069c None None] Authenticating user token {{(pid=88551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:06:08.009974 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG dbcounter [-] [88550] Writing DB stats keystone:SELECT=100 {{(pid=88550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:06:08.013495 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d846f7d0-5fea-4907-956a-4ef66b302998 None admin] Validating token access rules against request {{(pid=88550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:06:08.046151 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG dbcounter [-] [88551] Writing DB stats keystone:SELECT=100 {{(pid=88551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:06:08.049515 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6404026-3e3b-47b6-bbb4-03b9e10e983c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '819d41a279e64291acc60de51e1530ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:06:08.050142 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6404026-3e3b-47b6-bbb4-03b9e10e983c None admin] REQUEST_METHOD: `GET` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:06:08.050414 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6404026-3e3b-47b6-bbb4-03b9e10e983c None admin] SCRIPT_NAME: `/identity` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:06:08.050750 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6404026-3e3b-47b6-bbb4-03b9e10e983c None admin] PATH_INFO: `/v3/roles/member` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:06:08.062269 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6404026-3e3b-47b6-bbb4-03b9e10e983c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 17 19:06:08.067364 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application [None req-a6404026-3e3b-47b6-bbb4-03b9e10e983c None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 17 19:06:08.067364 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 19:06:08.067364 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 19:06:08.067364 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 19:06:08.067364 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 19:06:08.067364 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 19:06:08.067364 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 19:06:08.067364 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 19:06:08.067364 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 19:06:08.067364 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 19:06:08.067364 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 19:06:08.067364 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 19:06:08.067364 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 17 19:06:08.067364 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 17 19:06:08.067364 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 17 19:06:08.067364 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 17 19:06:08.074194 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 17 19:06:08.074194 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 17 19:06:08.074194 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 17 19:06:08.074194 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 17 19:06:08.074194 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 19:06:08.074194 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 19:06:08.074194 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 19:06:08.074194 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 19:06:08.074194 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 19:06:08.074194 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 19:06:08.074194 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 19:06:08.074194 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application with Lock( Aug 17 19:06:08.074194 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 19:06:08.074194 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return self._enter() Aug 17 19:06:08.074194 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 19:06:08.074194 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 19:06:08.075089 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 19:06:08.075089 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return self.creator() Aug 17 19:06:08.075089 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 19:06:08.075089 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application created_value = creator( Aug 17 19:06:08.075089 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 17 19:06:08.075089 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 17 19:06:08.075089 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 17 19:06:08.075089 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 17 19:06:08.075089 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 17 19:06:08.075089 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 17 19:06:08.075089 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 17 19:06:08.075089 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application Aug 17 19:06:08.075089 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: [pid: 88550|app: 0|req: 203/394] 10.222.0.26 () {56 vars in 1099 bytes} [Wed Aug 17 19:06:07 2022] GET /identity/v3/roles/member => generated 84 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 19:06:08.075089 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92bbcbb9-9247-401e-9bca-e1312d88bc48 None None] REQUEST_METHOD: `POST` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:06:08.075854 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92bbcbb9-9247-401e-9bca-e1312d88bc48 None None] SCRIPT_NAME: `/identity` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:06:08.075854 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92bbcbb9-9247-401e-9bca-e1312d88bc48 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:06:08.079902 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2c6c31e-8976-42b2-b903-6283df61069c None None] Validating token access rules against request {{(pid=88551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:06:08.095098 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.auth.core [None req-92bbcbb9-9247-401e-9bca-e1312d88bc48 None None] MFA Rules not processed for user `819d41a279e64291acc60de51e1530ae`. Rule list: `[]` (Enabled: `True`). {{(pid=88550) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 19:06:08.096566 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.common.fernet_utils [None req-92bbcbb9-9247-401e-9bca-e1312d88bc48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:06:08.119586 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27b992db-1296-4fba-ac6b-b09b90f0c3f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '819d41a279e64291acc60de51e1530ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:06:08.120274 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b992db-1296-4fba-ac6b-b09b90f0c3f0 None admin] REQUEST_METHOD: `PUT` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:06:08.123214 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b992db-1296-4fba-ac6b-b09b90f0c3f0 None admin] SCRIPT_NAME: `/identity` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:06:08.123214 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b992db-1296-4fba-ac6b-b09b90f0c3f0 None admin] PATH_INFO: `/v3/projects/143eeb5624b2449582a0739926bcb8e1/groups/075b91f7cf344f048495ae57f2301231/roles/60df6490940943d3b281ddaab1b0b9f7` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:06:08.123214 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27b992db-1296-4fba-ac6b-b09b90f0c3f0 None admin] RBAC: Authorizing `identity:create_grant(project_id=143eeb5624b2449582a0739926bcb8e1, group_id=075b91f7cf344f048495ae57f2301231, role_id=60df6490940943d3b281ddaab1b0b9f7)` {{(pid=88551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:06:08.124598 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27b992db-1296-4fba-ac6b-b09b90f0c3f0 None admin] RBAC: Authorization granted {{(pid=88551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:06:08.169075 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: [pid: 88550|app: 0|req: 204/395] 10.222.0.26 () {58 vars in 1024 bytes} [Wed Aug 17 19:06:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 17 19:06:08.169981 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92bbcbb9-9247-401e-9bca-e1312d88bc48 None None] Authenticating user token {{(pid=88550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:06:08.257148 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG dbcounter [-] [88550] Writing DB stats keystone:SELECT=100 {{(pid=88550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:06:08.272292 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92bbcbb9-9247-401e-9bca-e1312d88bc48 None None] Validating token access rules against request {{(pid=88550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:06:08.276041 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: [pid: 88551|app: 0|req: 192/396] 10.222.0.26 () {58 vars in 1442 bytes} [Wed Aug 17 19:06:07 2022] PUT /identity/v3/projects/143eeb5624b2449582a0739926bcb8e1/groups/075b91f7cf344f048495ae57f2301231/roles/60df6490940943d3b281ddaab1b0b9f7 => generated 0 bytes in 334 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 19:06:08.287706 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27b992db-1296-4fba-ac6b-b09b90f0c3f0 None admin] Authenticating user token {{(pid=88551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:06:08.320864 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df703282-7909-46db-94c8-1dd5f91ca565 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '819d41a279e64291acc60de51e1530ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:06:08.321717 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df703282-7909-46db-94c8-1dd5f91ca565 None admin] REQUEST_METHOD: `GET` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:06:08.322074 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df703282-7909-46db-94c8-1dd5f91ca565 None admin] SCRIPT_NAME: `/identity` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:06:08.322467 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df703282-7909-46db-94c8-1dd5f91ca565 None admin] PATH_INFO: `/v3/groups/075b91f7cf344f048495ae57f2301231` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:06:08.325006 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df703282-7909-46db-94c8-1dd5f91ca565 None admin] RBAC: Authorizing `identity:get_group(group_id=075b91f7cf344f048495ae57f2301231)` {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:06:08.327956 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df703282-7909-46db-94c8-1dd5f91ca565 None admin] RBAC: Authorization granted {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:06:08.334579 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: [pid: 88550|app: 0|req: 205/397] 10.222.0.26 () {56 vars in 1180 bytes} [Wed Aug 17 19:06:08 2022] GET /identity/v3/groups/075b91f7cf344f048495ae57f2301231 => generated 226 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 19:06:08.334579 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57829f21-9aff-4a1b-987d-870b073d0c7f None None] REQUEST_METHOD: `GET` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:06:08.334579 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57829f21-9aff-4a1b-987d-870b073d0c7f None None] SCRIPT_NAME: `/identity` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:06:08.334579 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57829f21-9aff-4a1b-987d-870b073d0c7f None None] PATH_INFO: `/` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:06:08.335106 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: [pid: 88550|app: 0|req: 206/398] 10.222.0.26 () {54 vars in 927 bytes} [Wed Aug 17 19:06:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 19:06:08.339833 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57829f21-9aff-4a1b-987d-870b073d0c7f None None] Authenticating user token {{(pid=88550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:06:08.446429 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27b992db-1296-4fba-ac6b-b09b90f0c3f0 None admin] Validating token access rules against request {{(pid=88551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:06:08.463657 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57829f21-9aff-4a1b-987d-870b073d0c7f None None] Validating token access rules against request {{(pid=88550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:06:08.492698 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-133494ff-e1ed-4479-b0ad-a25382a8fad6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '819d41a279e64291acc60de51e1530ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:06:08.493303 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133494ff-e1ed-4479-b0ad-a25382a8fad6 None admin] REQUEST_METHOD: `GET` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:06:08.494007 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133494ff-e1ed-4479-b0ad-a25382a8fad6 None admin] SCRIPT_NAME: `/identity` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:06:08.494007 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133494ff-e1ed-4479-b0ad-a25382a8fad6 None admin] PATH_INFO: `/v3/roles` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:06:08.494530 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-133494ff-e1ed-4479-b0ad-a25382a8fad6 None admin] RBAC: Adding query filter params (name=member) {{(pid=88551) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 19:06:08.494862 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-133494ff-e1ed-4479-b0ad-a25382a8fad6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:06:08.496266 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-133494ff-e1ed-4479-b0ad-a25382a8fad6 None admin] RBAC: Authorization granted {{(pid=88551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:06:08.510603 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: [pid: 88551|app: 0|req: 193/399] 10.222.0.26 () {56 vars in 1101 bytes} [Wed Aug 17 19:06:08 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 19:06:08.510603 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc71788e-eb46-4e05-ac6a-31f49bcde595 None None] REQUEST_METHOD: `POST` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:06:08.510603 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc71788e-eb46-4e05-ac6a-31f49bcde595 None None] SCRIPT_NAME: `/identity` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:06:08.510603 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc71788e-eb46-4e05-ac6a-31f49bcde595 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:06:08.516081 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG dbcounter [-] [88551] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:06:08.522620 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6bf7354-6c59-4c8d-ba52-207badc9b224 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '819d41a279e64291acc60de51e1530ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:06:08.523332 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6bf7354-6c59-4c8d-ba52-207badc9b224 None admin] REQUEST_METHOD: `GET` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:06:08.523618 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6bf7354-6c59-4c8d-ba52-207badc9b224 None admin] SCRIPT_NAME: `/identity` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:06:08.523905 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6bf7354-6c59-4c8d-ba52-207badc9b224 None admin] PATH_INFO: `/v3/projects/4ebe56b7d67e4584afee4a218097f2b4` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:06:08.525065 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6bf7354-6c59-4c8d-ba52-207badc9b224 None admin] RBAC: Authorizing `identity:get_project(project_id=4ebe56b7d67e4584afee4a218097f2b4)` {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:06:08.526582 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6bf7354-6c59-4c8d-ba52-207badc9b224 None admin] RBAC: Authorization granted {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:06:08.527219 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.auth.core [None req-bc71788e-eb46-4e05-ac6a-31f49bcde595 None None] MFA Rules not processed for user `819d41a279e64291acc60de51e1530ae`. Rule list: `[]` (Enabled: `True`). {{(pid=88551) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 19:06:08.528426 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: [pid: 88550|app: 0|req: 207/400] 10.222.0.26 () {56 vars in 1186 bytes} [Wed Aug 17 19:06:08 2022] GET /identity/v3/projects/4ebe56b7d67e4584afee4a218097f2b4 => generated 302 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 19:06:08.528583 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.common.fernet_utils [None req-bc71788e-eb46-4e05-ac6a-31f49bcde595 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:06:08.528993 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6bf7354-6c59-4c8d-ba52-207badc9b224 None admin] Authenticating user token {{(pid=88550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:06:08.557264 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG dbcounter [-] [88550] Writing DB stats keystone:SELECT=100 {{(pid=88550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:06:08.609331 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: [pid: 88551|app: 0|req: 194/401] 10.222.0.26 () {58 vars in 1024 bytes} [Wed Aug 17 19:06:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 17 19:06:08.610447 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc71788e-eb46-4e05-ac6a-31f49bcde595 None None] Authenticating user token {{(pid=88551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:06:08.650854 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6bf7354-6c59-4c8d-ba52-207badc9b224 None admin] Validating token access rules against request {{(pid=88550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:06:08.700423 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d53dedfa-c4ae-4f97-8122-99ce74f94755 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '819d41a279e64291acc60de51e1530ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:06:08.701479 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d53dedfa-c4ae-4f97-8122-99ce74f94755 None admin] REQUEST_METHOD: `GET` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:06:08.702331 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d53dedfa-c4ae-4f97-8122-99ce74f94755 None admin] SCRIPT_NAME: `/identity` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:06:08.702776 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d53dedfa-c4ae-4f97-8122-99ce74f94755 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:06:08.715430 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d53dedfa-c4ae-4f97-8122-99ce74f94755 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 17 19:06:08.720973 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application [None req-d53dedfa-c4ae-4f97-8122-99ce74f94755 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 17 19:06:08.720973 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 19:06:08.720973 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 19:06:08.720973 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 19:06:08.720973 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 19:06:08.720973 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 19:06:08.720973 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 19:06:08.720973 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 19:06:08.720973 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 19:06:08.720973 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 19:06:08.720973 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 19:06:08.720973 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 19:06:08.720973 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 17 19:06:08.720973 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 17 19:06:08.720973 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 17 19:06:08.720973 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 17 19:06:08.722105 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 17 19:06:08.722105 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 17 19:06:08.722105 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 17 19:06:08.722105 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 17 19:06:08.722105 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 19:06:08.722105 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 19:06:08.722105 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 19:06:08.722105 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 19:06:08.722105 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 19:06:08.722105 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 19:06:08.722105 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 19:06:08.722105 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application with Lock( Aug 17 19:06:08.722105 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 19:06:08.722105 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return self._enter() Aug 17 19:06:08.722105 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 19:06:08.722105 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 19:06:08.723077 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 19:06:08.723077 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return self.creator() Aug 17 19:06:08.723077 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 19:06:08.723077 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application created_value = creator( Aug 17 19:06:08.723077 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 17 19:06:08.723077 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 17 19:06:08.723077 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 17 19:06:08.723077 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 17 19:06:08.723077 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 17 19:06:08.723077 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 17 19:06:08.723077 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 17 19:06:08.723077 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application Aug 17 19:06:08.724204 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: [pid: 88550|app: 0|req: 208/402] 10.222.0.26 () {56 vars in 1114 bytes} [Wed Aug 17 19:06:08 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 19:06:08.725176 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d53dedfa-c4ae-4f97-8122-99ce74f94755 None admin] Authenticating user token {{(pid=88550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:06:08.744501 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc71788e-eb46-4e05-ac6a-31f49bcde595 None None] Validating token access rules against request {{(pid=88551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:06:08.794381 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdf06000-cd07-41ad-8ff0-2ef1af21c374 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '819d41a279e64291acc60de51e1530ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:06:08.796609 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf06000-cd07-41ad-8ff0-2ef1af21c374 None admin] REQUEST_METHOD: `GET` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:06:08.797404 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf06000-cd07-41ad-8ff0-2ef1af21c374 None admin] SCRIPT_NAME: `/identity` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:06:08.797898 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf06000-cd07-41ad-8ff0-2ef1af21c374 None admin] PATH_INFO: `/v3/groups/075b91f7cf344f048495ae57f2301231` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:06:08.799529 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdf06000-cd07-41ad-8ff0-2ef1af21c374 None admin] RBAC: Authorizing `identity:get_group(group_id=075b91f7cf344f048495ae57f2301231)` {{(pid=88551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:06:08.801491 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdf06000-cd07-41ad-8ff0-2ef1af21c374 None admin] RBAC: Authorization granted {{(pid=88551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:06:08.804003 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: [pid: 88551|app: 0|req: 195/403] 10.222.0.26 () {56 vars in 1180 bytes} [Wed Aug 17 19:06:08 2022] GET /identity/v3/groups/075b91f7cf344f048495ae57f2301231 => generated 226 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 19:06:08.805005 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdf06000-cd07-41ad-8ff0-2ef1af21c374 None admin] Authenticating user token {{(pid=88551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:06:08.809050 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG dbcounter [-] [88551] Writing DB stats keystone:SELECT=100 {{(pid=88551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:06:08.847553 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG dbcounter [-] [88550] Writing DB stats keystone:SELECT=100 {{(pid=88550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:06:08.867085 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d53dedfa-c4ae-4f97-8122-99ce74f94755 None admin] Validating token access rules against request {{(pid=88550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:06:08.909222 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-431da688-2406-4ba2-b4f1-813c0906304f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '819d41a279e64291acc60de51e1530ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:06:08.910241 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-431da688-2406-4ba2-b4f1-813c0906304f None admin] REQUEST_METHOD: `PUT` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:06:08.910754 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-431da688-2406-4ba2-b4f1-813c0906304f None admin] SCRIPT_NAME: `/identity` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:06:08.911209 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-431da688-2406-4ba2-b4f1-813c0906304f None admin] PATH_INFO: `/v3/projects/4ebe56b7d67e4584afee4a218097f2b4/groups/075b91f7cf344f048495ae57f2301231/roles/748773430faa4030989e1e77b3f361e1` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:06:08.913497 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-431da688-2406-4ba2-b4f1-813c0906304f None admin] RBAC: Authorizing `identity:create_grant(project_id=4ebe56b7d67e4584afee4a218097f2b4, group_id=075b91f7cf344f048495ae57f2301231, role_id=748773430faa4030989e1e77b3f361e1)` {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:06:08.915353 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-431da688-2406-4ba2-b4f1-813c0906304f None admin] RBAC: Authorization granted {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:06:08.951356 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdf06000-cd07-41ad-8ff0-2ef1af21c374 None admin] Validating token access rules against request {{(pid=88551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:06:08.987610 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88f43398-a6e5-4c92-a1b3-9cc294c4b3a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '819d41a279e64291acc60de51e1530ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:06:08.988277 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f43398-a6e5-4c92-a1b3-9cc294c4b3a0 None admin] REQUEST_METHOD: `GET` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:06:08.988484 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f43398-a6e5-4c92-a1b3-9cc294c4b3a0 None admin] SCRIPT_NAME: `/identity` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:06:08.988752 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f43398-a6e5-4c92-a1b3-9cc294c4b3a0 None admin] PATH_INFO: `/v3/roles` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:06:08.989505 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88f43398-a6e5-4c92-a1b3-9cc294c4b3a0 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=88551) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 19:06:08.989803 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88f43398-a6e5-4c92-a1b3-9cc294c4b3a0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:06:08.991200 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88f43398-a6e5-4c92-a1b3-9cc294c4b3a0 None admin] RBAC: Authorization granted {{(pid=88551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:06:09.000710 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: [pid: 88550|app: 0|req: 209/404] 10.222.0.26 () {58 vars in 1442 bytes} [Wed Aug 17 19:06:08 2022] PUT /identity/v3/projects/4ebe56b7d67e4584afee4a218097f2b4/groups/075b91f7cf344f048495ae57f2301231/roles/748773430faa4030989e1e77b3f361e1 => generated 0 bytes in 276 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 19:06:09.001028 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: [pid: 88551|app: 0|req: 196/405] 10.222.0.26 () {56 vars in 1111 bytes} [Wed Aug 17 19:06:08 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 19:06:09.001858 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88f43398-a6e5-4c92-a1b3-9cc294c4b3a0 None admin] Authenticating user token {{(pid=88551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:06:09.002023 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-431da688-2406-4ba2-b4f1-813c0906304f None admin] Authenticating user token {{(pid=88550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:06:09.099271 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG dbcounter [-] [88551] Writing DB stats keystone:SELECT=100 {{(pid=88551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:06:09.161932 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88f43398-a6e5-4c92-a1b3-9cc294c4b3a0 None admin] Validating token access rules against request {{(pid=88551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:06:09.174613 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-431da688-2406-4ba2-b4f1-813c0906304f None admin] Validating token access rules against request {{(pid=88550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:06:09.217088 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d13b1a9-75e3-435a-8fa0-c7bd25e639dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '819d41a279e64291acc60de51e1530ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:06:09.217855 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d13b1a9-75e3-435a-8fa0-c7bd25e639dc None admin] REQUEST_METHOD: `GET` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:06:09.218076 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3db65206-4656-41f4-92d7-6973f8cd837d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '819d41a279e64291acc60de51e1530ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:06:09.218197 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d13b1a9-75e3-435a-8fa0-c7bd25e639dc None admin] SCRIPT_NAME: `/identity` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:06:09.218417 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d13b1a9-75e3-435a-8fa0-c7bd25e639dc None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:06:09.218722 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db65206-4656-41f4-92d7-6973f8cd837d None admin] REQUEST_METHOD: `GET` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:06:09.219055 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db65206-4656-41f4-92d7-6973f8cd837d None admin] SCRIPT_NAME: `/identity` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:06:09.219279 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db65206-4656-41f4-92d7-6973f8cd837d None admin] PATH_INFO: `/v3/projects/143eeb5624b2449582a0739926bcb8e1` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:06:09.221700 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3db65206-4656-41f4-92d7-6973f8cd837d None admin] RBAC: Authorizing `identity:get_project(project_id=143eeb5624b2449582a0739926bcb8e1)` {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:06:09.223609 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3db65206-4656-41f4-92d7-6973f8cd837d None admin] RBAC: Authorization granted {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:06:09.225616 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: [pid: 88550|app: 0|req: 210/406] 10.222.0.26 () {56 vars in 1186 bytes} [Wed Aug 17 19:06:09 2022] GET /identity/v3/projects/143eeb5624b2449582a0739926bcb8e1 => generated 298 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 19:06:09.231178 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3db65206-4656-41f4-92d7-6973f8cd837d None admin] Authenticating user token {{(pid=88550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:06:09.239892 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d13b1a9-75e3-435a-8fa0-c7bd25e639dc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 17 19:06:09.245326 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application [None req-8d13b1a9-75e3-435a-8fa0-c7bd25e639dc None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 17 19:06:09.245326 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 19:06:09.245326 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 19:06:09.245326 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 19:06:09.245326 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 19:06:09.245326 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 19:06:09.245326 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 19:06:09.245326 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 19:06:09.245326 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 19:06:09.245326 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 19:06:09.245326 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 19:06:09.245326 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 19:06:09.245326 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 17 19:06:09.245326 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 17 19:06:09.245326 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 17 19:06:09.245326 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 17 19:06:09.247074 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 17 19:06:09.247074 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 17 19:06:09.247074 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 17 19:06:09.247074 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 17 19:06:09.247074 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 19:06:09.247074 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 19:06:09.247074 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 19:06:09.247074 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 19:06:09.247074 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 19:06:09.247074 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 19:06:09.247074 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 19:06:09.247074 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application with Lock( Aug 17 19:06:09.247074 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 19:06:09.247074 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application return self._enter() Aug 17 19:06:09.247074 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 19:06:09.247074 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 19:06:09.249281 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 19:06:09.249281 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application return self.creator() Aug 17 19:06:09.249281 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 19:06:09.249281 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application created_value = creator( Aug 17 19:06:09.249281 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 17 19:06:09.249281 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 17 19:06:09.249281 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 17 19:06:09.249281 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 17 19:06:09.249281 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 17 19:06:09.249281 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 17 19:06:09.249281 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 17 19:06:09.249281 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application Aug 17 19:06:09.249281 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: [pid: 88551|app: 0|req: 197/407] 10.222.0.26 () {56 vars in 1096 bytes} [Wed Aug 17 19:06:09 2022] GET /identity/v3/roles/admin => generated 83 bytes in 245 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 19:06:09.249281 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d13b1a9-75e3-435a-8fa0-c7bd25e639dc None admin] Authenticating user token {{(pid=88551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:06:09.257267 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG dbcounter [-] [88550] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:06:09.347546 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3db65206-4656-41f4-92d7-6973f8cd837d None admin] Validating token access rules against request {{(pid=88550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:06:09.392724 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d13b1a9-75e3-435a-8fa0-c7bd25e639dc None admin] Validating token access rules against request {{(pid=88551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:06:09.394298 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de06ae94-3ae3-4d5e-967b-e84b65b7d654 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '819d41a279e64291acc60de51e1530ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:06:09.395360 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de06ae94-3ae3-4d5e-967b-e84b65b7d654 None admin] REQUEST_METHOD: `GET` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:06:09.396754 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de06ae94-3ae3-4d5e-967b-e84b65b7d654 None admin] SCRIPT_NAME: `/identity` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:06:09.397222 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de06ae94-3ae3-4d5e-967b-e84b65b7d654 None admin] PATH_INFO: `/v3/groups/075b91f7cf344f048495ae57f2301231` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:06:09.398697 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de06ae94-3ae3-4d5e-967b-e84b65b7d654 None admin] RBAC: Authorizing `identity:get_group(group_id=075b91f7cf344f048495ae57f2301231)` {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:06:09.400394 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de06ae94-3ae3-4d5e-967b-e84b65b7d654 None admin] RBAC: Authorization granted {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:06:09.402914 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: [pid: 88550|app: 0|req: 211/408] 10.222.0.26 () {56 vars in 1180 bytes} [Wed Aug 17 19:06:09 2022] GET /identity/v3/groups/075b91f7cf344f048495ae57f2301231 => generated 226 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 19:06:09.409634 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de06ae94-3ae3-4d5e-967b-e84b65b7d654 None admin] Authenticating user token {{(pid=88550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:06:09.426373 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG dbcounter [-] [88551] Writing DB stats keystone:SELECT=100 {{(pid=88551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:06:09.438828 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67531394-1d6a-4d71-a87f-cfd9d5ad649f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '819d41a279e64291acc60de51e1530ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:06:09.440351 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67531394-1d6a-4d71-a87f-cfd9d5ad649f None admin] REQUEST_METHOD: `PUT` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:06:09.440351 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67531394-1d6a-4d71-a87f-cfd9d5ad649f None admin] SCRIPT_NAME: `/identity` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:06:09.440351 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67531394-1d6a-4d71-a87f-cfd9d5ad649f None admin] PATH_INFO: `/v3/projects/143eeb5624b2449582a0739926bcb8e1/groups/075b91f7cf344f048495ae57f2301231/roles/748773430faa4030989e1e77b3f361e1` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:06:09.442758 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67531394-1d6a-4d71-a87f-cfd9d5ad649f None admin] RBAC: Authorizing `identity:create_grant(project_id=143eeb5624b2449582a0739926bcb8e1, group_id=075b91f7cf344f048495ae57f2301231, role_id=748773430faa4030989e1e77b3f361e1)` {{(pid=88551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:06:09.444334 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67531394-1d6a-4d71-a87f-cfd9d5ad649f None admin] RBAC: Authorization granted {{(pid=88551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:06:09.510223 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG dbcounter [-] [88550] Writing DB stats keystone:SELECT=100 {{(pid=88550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:06:09.539754 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: [pid: 88551|app: 0|req: 198/409] 10.222.0.26 () {58 vars in 1442 bytes} [Wed Aug 17 19:06:09 2022] PUT /identity/v3/projects/143eeb5624b2449582a0739926bcb8e1/groups/075b91f7cf344f048495ae57f2301231/roles/748773430faa4030989e1e77b3f361e1 => generated 0 bytes in 292 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 19:06:09.541933 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de06ae94-3ae3-4d5e-967b-e84b65b7d654 None admin] Validating token access rules against request {{(pid=88550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:06:09.550033 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67531394-1d6a-4d71-a87f-cfd9d5ad649f None admin] Authenticating user token {{(pid=88551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:06:09.638220 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb62d7f8-fe3e-4b88-a604-df3e5cb0d2d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '819d41a279e64291acc60de51e1530ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:06:09.640992 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb62d7f8-fe3e-4b88-a604-df3e5cb0d2d3 None admin] REQUEST_METHOD: `GET` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:06:09.641505 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb62d7f8-fe3e-4b88-a604-df3e5cb0d2d3 None admin] SCRIPT_NAME: `/identity` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:06:09.642349 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb62d7f8-fe3e-4b88-a604-df3e5cb0d2d3 None admin] PATH_INFO: `/v3/roles` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:06:09.644852 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb62d7f8-fe3e-4b88-a604-df3e5cb0d2d3 None admin] RBAC: Adding query filter params (name=admin) {{(pid=88550) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 19:06:09.645443 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb62d7f8-fe3e-4b88-a604-df3e5cb0d2d3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:06:09.648582 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb62d7f8-fe3e-4b88-a604-df3e5cb0d2d3 None admin] RBAC: Authorization granted {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:06:09.674443 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: [pid: 88550|app: 0|req: 212/410] 10.222.0.26 () {56 vars in 1099 bytes} [Wed Aug 17 19:06:09 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 261 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 19:06:09.680384 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb62d7f8-fe3e-4b88-a604-df3e5cb0d2d3 None admin] Authenticating user token {{(pid=88550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:06:09.753706 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67531394-1d6a-4d71-a87f-cfd9d5ad649f None admin] Validating token access rules against request {{(pid=88551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:06:09.789848 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19b1a4e4-b350-46a7-a87e-764984dfae1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '819d41a279e64291acc60de51e1530ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:06:09.790845 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b1a4e4-b350-46a7-a87e-764984dfae1c None admin] REQUEST_METHOD: `GET` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:06:09.790845 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b1a4e4-b350-46a7-a87e-764984dfae1c None admin] SCRIPT_NAME: `/identity` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:06:09.791012 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b1a4e4-b350-46a7-a87e-764984dfae1c None admin] PATH_INFO: `/v3/projects/4ebe56b7d67e4584afee4a218097f2b4` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:06:09.792136 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19b1a4e4-b350-46a7-a87e-764984dfae1c None admin] RBAC: Authorizing `identity:get_project(project_id=4ebe56b7d67e4584afee4a218097f2b4)` {{(pid=88551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:06:09.793607 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19b1a4e4-b350-46a7-a87e-764984dfae1c None admin] RBAC: Authorization granted {{(pid=88551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:06:09.800178 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: [pid: 88551|app: 0|req: 199/411] 10.222.0.26 () {56 vars in 1186 bytes} [Wed Aug 17 19:06:09 2022] GET /identity/v3/projects/4ebe56b7d67e4584afee4a218097f2b4 => generated 302 bytes in 256 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 19:06:09.807830 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19b1a4e4-b350-46a7-a87e-764984dfae1c None admin] Authenticating user token {{(pid=88551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:06:09.811214 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb62d7f8-fe3e-4b88-a604-df3e5cb0d2d3 None admin] Validating token access rules against request {{(pid=88550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:06:09.854039 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdda68a3-4434-48fa-bfab-4e535947e56f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '819d41a279e64291acc60de51e1530ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:06:09.854738 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdda68a3-4434-48fa-bfab-4e535947e56f None admin] REQUEST_METHOD: `GET` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:06:09.856675 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdda68a3-4434-48fa-bfab-4e535947e56f None admin] SCRIPT_NAME: `/identity` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:06:09.856675 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdda68a3-4434-48fa-bfab-4e535947e56f None admin] PATH_INFO: `/v3/groups/16e76c6f45ec4715adcb2a632c7275e0` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:06:09.858430 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdda68a3-4434-48fa-bfab-4e535947e56f None admin] RBAC: Authorizing `identity:get_group(group_id=16e76c6f45ec4715adcb2a632c7275e0)` {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:06:09.859925 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdda68a3-4434-48fa-bfab-4e535947e56f None admin] RBAC: Authorization granted {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:06:09.861838 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: [pid: 88550|app: 0|req: 213/412] 10.222.0.26 () {56 vars in 1180 bytes} [Wed Aug 17 19:06:09 2022] GET /identity/v3/groups/16e76c6f45ec4715adcb2a632c7275e0 => generated 229 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 17 19:06:09.867727 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdda68a3-4434-48fa-bfab-4e535947e56f None admin] Authenticating user token {{(pid=88550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:06:09.880734 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG dbcounter [-] [88551] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:06:09.886977 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG dbcounter [-] [88550] Writing DB stats keystone:SELECT=100 {{(pid=88550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:06:09.966426 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19b1a4e4-b350-46a7-a87e-764984dfae1c None admin] Validating token access rules against request {{(pid=88551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:06:10.029449 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bcd5a37-6fed-429f-a9c9-eb5cbb67a7ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '819d41a279e64291acc60de51e1530ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:06:10.030724 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bcd5a37-6fed-429f-a9c9-eb5cbb67a7ee None admin] REQUEST_METHOD: `PUT` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:06:10.031019 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bcd5a37-6fed-429f-a9c9-eb5cbb67a7ee None admin] SCRIPT_NAME: `/identity` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:06:10.031301 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bcd5a37-6fed-429f-a9c9-eb5cbb67a7ee None admin] PATH_INFO: `/v3/projects/4ebe56b7d67e4584afee4a218097f2b4/groups/075b91f7cf344f048495ae57f2301231/roles/60df6490940943d3b281ddaab1b0b9f7` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:06:10.032583 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdda68a3-4434-48fa-bfab-4e535947e56f None admin] Validating token access rules against request {{(pid=88550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:06:10.033550 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bcd5a37-6fed-429f-a9c9-eb5cbb67a7ee None admin] RBAC: Authorizing `identity:create_grant(project_id=4ebe56b7d67e4584afee4a218097f2b4, group_id=075b91f7cf344f048495ae57f2301231, role_id=60df6490940943d3b281ddaab1b0b9f7)` {{(pid=88551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:06:10.035574 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bcd5a37-6fed-429f-a9c9-eb5cbb67a7ee None admin] RBAC: Authorization granted {{(pid=88551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:06:10.071869 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26e4b288-0f88-4b04-9efb-2aee689c8666 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '819d41a279e64291acc60de51e1530ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:06:10.072450 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e4b288-0f88-4b04-9efb-2aee689c8666 None admin] REQUEST_METHOD: `GET` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:06:10.072769 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e4b288-0f88-4b04-9efb-2aee689c8666 None admin] SCRIPT_NAME: `/identity` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:06:10.073053 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e4b288-0f88-4b04-9efb-2aee689c8666 None admin] PATH_INFO: `/v3/projects/d0490e0db9a14e81a7ea7b108a7ad6a0` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:06:10.074265 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26e4b288-0f88-4b04-9efb-2aee689c8666 None admin] RBAC: Authorizing `identity:get_project(project_id=d0490e0db9a14e81a7ea7b108a7ad6a0)` {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:06:10.075802 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26e4b288-0f88-4b04-9efb-2aee689c8666 None admin] RBAC: Authorization granted {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:06:10.078056 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: [pid: 88550|app: 0|req: 214/413] 10.222.0.26 () {56 vars in 1186 bytes} [Wed Aug 17 19:06:09 2022] GET /identity/v3/projects/d0490e0db9a14e81a7ea7b108a7ad6a0 => generated 344 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 17 19:06:10.083990 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26e4b288-0f88-4b04-9efb-2aee689c8666 None admin] Authenticating user token {{(pid=88550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:06:10.108872 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: [pid: 88551|app: 0|req: 200/414] 10.222.0.26 () {58 vars in 1442 bytes} [Wed Aug 17 19:06:09 2022] PUT /identity/v3/projects/4ebe56b7d67e4584afee4a218097f2b4/groups/075b91f7cf344f048495ae57f2301231/roles/60df6490940943d3b281ddaab1b0b9f7 => generated 0 bytes in 303 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 17 19:06:10.198796 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG dbcounter [-] [88550] Writing DB stats keystone:SELECT=100 {{(pid=88550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:06:10.231250 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26e4b288-0f88-4b04-9efb-2aee689c8666 None admin] Validating token access rules against request {{(pid=88550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:06:10.277792 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92d6ce6d-306d-4fb2-835b-cd54c350db40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '819d41a279e64291acc60de51e1530ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:06:10.278923 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d6ce6d-306d-4fb2-835b-cd54c350db40 None admin] REQUEST_METHOD: `PUT` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:06:10.279437 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d6ce6d-306d-4fb2-835b-cd54c350db40 None admin] SCRIPT_NAME: `/identity` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:06:10.280561 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d6ce6d-306d-4fb2-835b-cd54c350db40 None admin] PATH_INFO: `/v3/projects/d0490e0db9a14e81a7ea7b108a7ad6a0/groups/16e76c6f45ec4715adcb2a632c7275e0/roles/204f62ae18174b60a2e3f5d4f28ea326` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:06:10.283088 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92d6ce6d-306d-4fb2-835b-cd54c350db40 None admin] RBAC: Authorizing `identity:create_grant(project_id=d0490e0db9a14e81a7ea7b108a7ad6a0, group_id=16e76c6f45ec4715adcb2a632c7275e0, role_id=204f62ae18174b60a2e3f5d4f28ea326)` {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:06:10.285122 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92d6ce6d-306d-4fb2-835b-cd54c350db40 None admin] RBAC: Authorization granted {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:06:10.362248 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: [pid: 88550|app: 0|req: 215/415] 10.222.0.26 () {58 vars in 1442 bytes} [Wed Aug 17 19:06:10 2022] PUT /identity/v3/projects/d0490e0db9a14e81a7ea7b108a7ad6a0/groups/16e76c6f45ec4715adcb2a632c7275e0/roles/204f62ae18174b60a2e3f5d4f28ea326 => generated 0 bytes in 278 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 19:06:10.680457 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2fc081a-0f93-4fc2-bacd-203e8889b13b None None] REQUEST_METHOD: `GET` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:06:10.681434 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2fc081a-0f93-4fc2-bacd-203e8889b13b None None] SCRIPT_NAME: `/identity` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:06:10.681934 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2fc081a-0f93-4fc2-bacd-203e8889b13b None None] PATH_INFO: `/` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:06:10.683849 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: [pid: 88551|app: 0|req: 201/416] 10.222.0.26 () {54 vars in 927 bytes} [Wed Aug 17 19:06:10 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 19:06:10.691044 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b978e49c-d3fa-4611-8a6c-c10396ac644e None None] REQUEST_METHOD: `POST` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:06:10.692119 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b978e49c-d3fa-4611-8a6c-c10396ac644e None None] SCRIPT_NAME: `/identity` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:06:10.692592 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b978e49c-d3fa-4611-8a6c-c10396ac644e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:06:10.713553 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.auth.core [None req-b978e49c-d3fa-4611-8a6c-c10396ac644e None None] MFA Rules not processed for user `819d41a279e64291acc60de51e1530ae`. Rule list: `[]` (Enabled: `True`). {{(pid=88550) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 19:06:10.715142 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.common.fernet_utils [None req-b978e49c-d3fa-4611-8a6c-c10396ac644e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:06:10.794900 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: [pid: 88550|app: 0|req: 216/417] 10.222.0.26 () {58 vars in 1024 bytes} [Wed Aug 17 19:06:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 17 19:06:11.227608 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2fc081a-0f93-4fc2-bacd-203e8889b13b None None] Authenticating user token {{(pid=88551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:06:11.372299 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2fc081a-0f93-4fc2-bacd-203e8889b13b None None] Validating token access rules against request {{(pid=88551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:06:11.394853 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG dbcounter [-] [88551] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:06:11.423632 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47819f97-0903-4427-9bce-bcb7ff45eeb9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '819d41a279e64291acc60de51e1530ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:06:11.424313 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47819f97-0903-4427-9bce-bcb7ff45eeb9 None admin] REQUEST_METHOD: `GET` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:06:11.424592 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47819f97-0903-4427-9bce-bcb7ff45eeb9 None admin] SCRIPT_NAME: `/identity` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:06:11.424902 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47819f97-0903-4427-9bce-bcb7ff45eeb9 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:06:11.443473 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47819f97-0903-4427-9bce-bcb7ff45eeb9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 17 19:06:11.448709 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application [None req-47819f97-0903-4427-9bce-bcb7ff45eeb9 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 17 19:06:11.448709 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 19:06:11.448709 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 19:06:11.448709 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 19:06:11.448709 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 19:06:11.448709 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 19:06:11.448709 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 19:06:11.448709 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 19:06:11.448709 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 19:06:11.448709 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 19:06:11.448709 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 19:06:11.448709 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 19:06:11.448709 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 17 19:06:11.448709 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 17 19:06:11.448709 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 17 19:06:11.448709 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 17 19:06:11.449570 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 17 19:06:11.449570 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 17 19:06:11.449570 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 17 19:06:11.449570 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 17 19:06:11.449570 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 19:06:11.449570 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 19:06:11.449570 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 19:06:11.449570 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 19:06:11.449570 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 19:06:11.449570 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 19:06:11.449570 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 19:06:11.449570 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application with Lock( Aug 17 19:06:11.449570 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 19:06:11.449570 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application return self._enter() Aug 17 19:06:11.449570 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 19:06:11.449570 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 19:06:11.450447 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 19:06:11.450447 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application return self.creator() Aug 17 19:06:11.450447 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 19:06:11.450447 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application created_value = creator( Aug 17 19:06:11.450447 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 17 19:06:11.450447 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 17 19:06:11.450447 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 17 19:06:11.450447 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 17 19:06:11.450447 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 17 19:06:11.450447 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 17 19:06:11.450447 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 17 19:06:11.450447 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application Aug 17 19:06:11.453153 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: [pid: 88551|app: 0|req: 202/418] 10.222.0.26 () {56 vars in 1114 bytes} [Wed Aug 17 19:06:11 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 226 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 19:06:11.459017 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b978e49c-d3fa-4611-8a6c-c10396ac644e None None] Authenticating user token {{(pid=88550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:06:11.573311 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG dbcounter [-] [88550] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:06:11.625273 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b978e49c-d3fa-4611-8a6c-c10396ac644e None None] Validating token access rules against request {{(pid=88550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:06:11.667020 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b93cb3e5-02b9-4fd2-b655-9abb2711c407 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '819d41a279e64291acc60de51e1530ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:06:11.667686 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b93cb3e5-02b9-4fd2-b655-9abb2711c407 None admin] REQUEST_METHOD: `GET` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:06:11.667969 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b93cb3e5-02b9-4fd2-b655-9abb2711c407 None admin] SCRIPT_NAME: `/identity` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:06:11.668239 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b93cb3e5-02b9-4fd2-b655-9abb2711c407 None admin] PATH_INFO: `/v3/roles` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:06:11.668983 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b93cb3e5-02b9-4fd2-b655-9abb2711c407 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=88550) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 19:06:11.669283 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b93cb3e5-02b9-4fd2-b655-9abb2711c407 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:06:11.671342 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b93cb3e5-02b9-4fd2-b655-9abb2711c407 None admin] RBAC: Authorization granted {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:06:11.680534 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: [pid: 88550|app: 0|req: 217/419] 10.222.0.26 () {56 vars in 1111 bytes} [Wed Aug 17 19:06:11 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 19:06:11.686378 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47819f97-0903-4427-9bce-bcb7ff45eeb9 None admin] Authenticating user token {{(pid=88551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:06:11.696361 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c69ba9fa-53ed-4f40-b9bf-dc4be02c7245 None None] REQUEST_METHOD: `GET` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:06:11.696835 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c69ba9fa-53ed-4f40-b9bf-dc4be02c7245 None None] SCRIPT_NAME: `/identity` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:06:11.696909 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c69ba9fa-53ed-4f40-b9bf-dc4be02c7245 None None] PATH_INFO: `/` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:06:11.698498 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: [pid: 88550|app: 0|req: 218/420] 10.222.0.26 () {54 vars in 927 bytes} [Wed Aug 17 19:06:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 17 19:06:11.703360 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a7cf20-a9c5-42f5-a43f-fbe0d85e2e3e None None] REQUEST_METHOD: `POST` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:06:11.703645 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a7cf20-a9c5-42f5-a43f-fbe0d85e2e3e None None] SCRIPT_NAME: `/identity` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:06:11.703918 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a7cf20-a9c5-42f5-a43f-fbe0d85e2e3e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:06:11.733521 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.auth.core [None req-26a7cf20-a9c5-42f5-a43f-fbe0d85e2e3e None None] MFA Rules not processed for user `819d41a279e64291acc60de51e1530ae`. Rule list: `[]` (Enabled: `True`). {{(pid=88550) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 19:06:11.734784 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.common.fernet_utils [None req-26a7cf20-a9c5-42f5-a43f-fbe0d85e2e3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:06:11.840814 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: [pid: 88550|app: 0|req: 219/421] 10.222.0.26 () {58 vars in 1024 bytes} [Wed Aug 17 19:06:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 17 19:06:11.860585 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47819f97-0903-4427-9bce-bcb7ff45eeb9 None admin] Validating token access rules against request {{(pid=88551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:06:11.902264 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9a1edaa-0b1c-4964-b18b-aa7122b4a461 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '819d41a279e64291acc60de51e1530ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:06:11.902907 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a1edaa-0b1c-4964-b18b-aa7122b4a461 None admin] REQUEST_METHOD: `GET` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:06:11.903185 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a1edaa-0b1c-4964-b18b-aa7122b4a461 None admin] SCRIPT_NAME: `/identity` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:06:11.903454 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a1edaa-0b1c-4964-b18b-aa7122b4a461 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:06:11.970110 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG dbcounter [-] [88551] Writing DB stats keystone:SELECT=100 {{(pid=88551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:06:12.001862 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9a1edaa-0b1c-4964-b18b-aa7122b4a461 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:06:12.007475 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9a1edaa-0b1c-4964-b18b-aa7122b4a461 None admin] RBAC: Authorization granted {{(pid=88551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:06:12.113345 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: [pid: 88551|app: 0|req: 203/422] 10.222.0.26 () {58 vars in 1282 bytes} [Wed Aug 17 19:06:11 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 427 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 17 19:06:12.123639 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26a7cf20-a9c5-42f5-a43f-fbe0d85e2e3e None None] Authenticating user token {{(pid=88550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:06:12.209401 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9a1edaa-0b1c-4964-b18b-aa7122b4a461 None admin] Authenticating user token {{(pid=88551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:06:12.222828 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG dbcounter [-] [88550] Writing DB stats keystone:SELECT=100 {{(pid=88550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:06:12.304000 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26a7cf20-a9c5-42f5-a43f-fbe0d85e2e3e None None] Validating token access rules against request {{(pid=88550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:06:12.342038 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG dbcounter [-] [88551] Writing DB stats keystone:SELECT=100 {{(pid=88551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:06:12.365476 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4575586c-ca4f-4cc5-9534-b319ba7d2a09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '819d41a279e64291acc60de51e1530ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:06:12.366031 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4575586c-ca4f-4cc5-9534-b319ba7d2a09 None admin] REQUEST_METHOD: `GET` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:06:12.366306 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4575586c-ca4f-4cc5-9534-b319ba7d2a09 None admin] SCRIPT_NAME: `/identity` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:06:12.366588 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4575586c-ca4f-4cc5-9534-b319ba7d2a09 None admin] PATH_INFO: `/v3/projects/143eeb5624b2449582a0739926bcb8e1` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:06:12.367719 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4575586c-ca4f-4cc5-9534-b319ba7d2a09 None admin] RBAC: Authorizing `identity:get_project(project_id=143eeb5624b2449582a0739926bcb8e1)` {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:06:12.369160 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4575586c-ca4f-4cc5-9534-b319ba7d2a09 None admin] RBAC: Authorization granted {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:06:12.372811 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: [pid: 88550|app: 0|req: 220/423] 10.222.0.26 () {56 vars in 1186 bytes} [Wed Aug 17 19:06:12 2022] GET /identity/v3/projects/143eeb5624b2449582a0739926bcb8e1 => generated 298 bytes in 249 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 19:06:12.382102 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4575586c-ca4f-4cc5-9534-b319ba7d2a09 None admin] Authenticating user token {{(pid=88550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:06:12.402143 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9a1edaa-0b1c-4964-b18b-aa7122b4a461 None admin] Validating token access rules against request {{(pid=88551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:06:12.479269 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-666aa708-106d-470f-b99e-7da8aff67beb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '819d41a279e64291acc60de51e1530ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:06:12.480011 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-666aa708-106d-470f-b99e-7da8aff67beb None admin] REQUEST_METHOD: `GET` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:06:12.480292 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-666aa708-106d-470f-b99e-7da8aff67beb None admin] SCRIPT_NAME: `/identity` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:06:12.480568 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-666aa708-106d-470f-b99e-7da8aff67beb None admin] PATH_INFO: `/v3/roles/member` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:06:12.499916 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-666aa708-106d-470f-b99e-7da8aff67beb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 17 19:06:12.506645 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application [None req-666aa708-106d-470f-b99e-7da8aff67beb None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 17 19:06:12.506645 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 19:06:12.506645 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 19:06:12.506645 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 19:06:12.506645 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 19:06:12.506645 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 19:06:12.506645 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 19:06:12.506645 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 19:06:12.506645 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 19:06:12.506645 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 19:06:12.506645 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 19:06:12.506645 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 19:06:12.506645 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 17 19:06:12.506645 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 17 19:06:12.506645 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 17 19:06:12.506645 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 17 19:06:12.509040 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 17 19:06:12.509040 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 17 19:06:12.509040 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 17 19:06:12.509040 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 17 19:06:12.509040 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 19:06:12.509040 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 19:06:12.509040 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 19:06:12.509040 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 19:06:12.509040 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 19:06:12.509040 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 19:06:12.509040 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 19:06:12.509040 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application with Lock( Aug 17 19:06:12.509040 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 19:06:12.509040 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application return self._enter() Aug 17 19:06:12.509040 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 19:06:12.509040 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 19:06:12.510021 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 19:06:12.510021 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application return self.creator() Aug 17 19:06:12.510021 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 19:06:12.510021 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application created_value = creator( Aug 17 19:06:12.510021 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 17 19:06:12.510021 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 17 19:06:12.510021 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 17 19:06:12.510021 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 17 19:06:12.510021 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 17 19:06:12.510021 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 17 19:06:12.510021 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 17 19:06:12.510021 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application Aug 17 19:06:12.514026 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: [pid: 88551|app: 0|req: 204/424] 10.222.0.26 () {56 vars in 1099 bytes} [Wed Aug 17 19:06:12 2022] GET /identity/v3/roles/member => generated 84 bytes in 305 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 17 19:06:12.519257 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-666aa708-106d-470f-b99e-7da8aff67beb None admin] Authenticating user token {{(pid=88551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:06:12.582879 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4575586c-ca4f-4cc5-9534-b319ba7d2a09 None admin] Validating token access rules against request {{(pid=88550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:06:12.629194 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG dbcounter [-] [88550] Writing DB stats keystone:SELECT=100 {{(pid=88550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:06:12.638696 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3331213a-81e5-4b71-818f-fd645658dd41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '819d41a279e64291acc60de51e1530ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:06:12.640044 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3331213a-81e5-4b71-818f-fd645658dd41 None admin] REQUEST_METHOD: `GET` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:06:12.644711 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3331213a-81e5-4b71-818f-fd645658dd41 None admin] SCRIPT_NAME: `/identity` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:06:12.644711 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3331213a-81e5-4b71-818f-fd645658dd41 None admin] PATH_INFO: `/v3/groups/075b91f7cf344f048495ae57f2301231` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:06:12.644711 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3331213a-81e5-4b71-818f-fd645658dd41 None admin] RBAC: Authorizing `identity:get_group(group_id=075b91f7cf344f048495ae57f2301231)` {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:06:12.644711 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3331213a-81e5-4b71-818f-fd645658dd41 None admin] RBAC: Authorization granted {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:06:12.650571 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: [pid: 88550|app: 0|req: 221/425] 10.222.0.26 () {56 vars in 1180 bytes} [Wed Aug 17 19:06:12 2022] GET /identity/v3/groups/075b91f7cf344f048495ae57f2301231 => generated 226 bytes in 267 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 17 19:06:12.650571 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b49946-3477-47a5-95e2-904cc2b092e0 None None] REQUEST_METHOD: `GET` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:06:12.650571 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b49946-3477-47a5-95e2-904cc2b092e0 None None] SCRIPT_NAME: `/identity` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:06:12.650571 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b49946-3477-47a5-95e2-904cc2b092e0 None None] PATH_INFO: `/` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:06:12.655063 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: [pid: 88550|app: 0|req: 222/426] 10.222.0.26 () {54 vars in 927 bytes} [Wed Aug 17 19:06:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 19:06:12.657678 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad9eeb8-0ae5-4320-9864-241ab70981d3 None None] REQUEST_METHOD: `POST` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:06:12.657966 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad9eeb8-0ae5-4320-9864-241ab70981d3 None None] SCRIPT_NAME: `/identity` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:06:12.658241 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad9eeb8-0ae5-4320-9864-241ab70981d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:06:12.685341 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.auth.core [None req-3ad9eeb8-0ae5-4320-9864-241ab70981d3 None None] MFA Rules not processed for user `819d41a279e64291acc60de51e1530ae`. Rule list: `[]` (Enabled: `True`). {{(pid=88550) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 19:06:12.687674 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.common.fernet_utils [None req-3ad9eeb8-0ae5-4320-9864-241ab70981d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:06:12.690458 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-666aa708-106d-470f-b99e-7da8aff67beb None admin] Validating token access rules against request {{(pid=88551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:06:12.731687 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG dbcounter [-] [88551] Writing DB stats keystone:SELECT=100 {{(pid=88551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:06:12.739456 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-658f1e12-3aa2-461c-bb9b-d31d4c786328 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '819d41a279e64291acc60de51e1530ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:06:12.740210 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-658f1e12-3aa2-461c-bb9b-d31d4c786328 None admin] REQUEST_METHOD: `GET` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:06:12.741239 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-658f1e12-3aa2-461c-bb9b-d31d4c786328 None admin] SCRIPT_NAME: `/identity` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:06:12.741239 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-658f1e12-3aa2-461c-bb9b-d31d4c786328 None admin] PATH_INFO: `/v3/roles` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:06:12.741716 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-658f1e12-3aa2-461c-bb9b-d31d4c786328 None admin] RBAC: Adding query filter params (name=member) {{(pid=88551) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 19:06:12.742169 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-658f1e12-3aa2-461c-bb9b-d31d4c786328 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:06:12.743871 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-658f1e12-3aa2-461c-bb9b-d31d4c786328 None admin] RBAC: Authorization granted {{(pid=88551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:06:12.754770 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: [pid: 88551|app: 0|req: 205/427] 10.222.0.26 () {56 vars in 1101 bytes} [Wed Aug 17 19:06:12 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 17 19:06:12.755834 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-658f1e12-3aa2-461c-bb9b-d31d4c786328 None admin] Authenticating user token {{(pid=88551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:06:12.778915 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: [pid: 88550|app: 0|req: 223/428] 10.222.0.26 () {58 vars in 1024 bytes} [Wed Aug 17 19:06:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 17 19:06:12.780516 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ad9eeb8-0ae5-4320-9864-241ab70981d3 None None] Authenticating user token {{(pid=88550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:06:12.894512 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ad9eeb8-0ae5-4320-9864-241ab70981d3 None None] Validating token access rules against request {{(pid=88550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:06:12.910852 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-658f1e12-3aa2-461c-bb9b-d31d4c786328 None admin] Validating token access rules against request {{(pid=88551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:06:12.923803 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG dbcounter [-] [88550] Writing DB stats keystone:SELECT=100 {{(pid=88550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:06:12.933802 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29673e85-6407-44c9-b373-37dfa9a00903 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '819d41a279e64291acc60de51e1530ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:06:12.947892 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29673e85-6407-44c9-b373-37dfa9a00903 None admin] REQUEST_METHOD: `GET` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:06:12.947892 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29673e85-6407-44c9-b373-37dfa9a00903 None admin] SCRIPT_NAME: `/identity` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:06:12.947892 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29673e85-6407-44c9-b373-37dfa9a00903 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:06:12.963505 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a68d5d0-1e0f-4323-b48a-d14be50c9374 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '819d41a279e64291acc60de51e1530ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:06:12.964124 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a68d5d0-1e0f-4323-b48a-d14be50c9374 None admin] REQUEST_METHOD: `GET` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:06:12.964409 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a68d5d0-1e0f-4323-b48a-d14be50c9374 None admin] SCRIPT_NAME: `/identity` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:06:12.964685 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a68d5d0-1e0f-4323-b48a-d14be50c9374 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:06:12.965536 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a68d5d0-1e0f-4323-b48a-d14be50c9374 None admin] RBAC: Adding query filter params (group.id=075b91f7cf344f048495ae57f2301231, role.id=60df6490940943d3b281ddaab1b0b9f7, scope.project.id=143eeb5624b2449582a0739926bcb8e1) {{(pid=88551) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 19:06:12.965781 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a68d5d0-1e0f-4323-b48a-d14be50c9374 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:06:12.967317 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a68d5d0-1e0f-4323-b48a-d14be50c9374 None admin] RBAC: Authorization granted {{(pid=88551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:06:12.987393 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: [pid: 88551|app: 0|req: 206/429] 10.222.0.26 () {56 vars in 1376 bytes} [Wed Aug 17 19:06:12 2022] GET /identity/v3/role_assignments?group.id=075b91f7cf344f048495ae57f2301231&scope.project.id=143eeb5624b2449582a0739926bcb8e1&role.id=60df6490940943d3b281ddaab1b0b9f7 => generated 611 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 19:06:13.027876 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29673e85-6407-44c9-b373-37dfa9a00903 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:06:13.029738 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29673e85-6407-44c9-b373-37dfa9a00903 None admin] RBAC: Authorization granted {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:06:13.082944 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3865eebd-6365-47c5-84bf-3224cf675dd3 None None] REQUEST_METHOD: `GET` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:06:13.082944 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3865eebd-6365-47c5-84bf-3224cf675dd3 None None] SCRIPT_NAME: `/identity` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:06:13.083238 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3865eebd-6365-47c5-84bf-3224cf675dd3 None None] PATH_INFO: `/` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:06:13.085811 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: [pid: 88551|app: 0|req: 207/430] 10.222.0.26 () {54 vars in 927 bytes} [Wed Aug 17 19:06:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 17 19:06:13.089925 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f70a18-64ba-4cfe-ac9e-75921283f3f6 None None] REQUEST_METHOD: `POST` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:06:13.090234 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f70a18-64ba-4cfe-ac9e-75921283f3f6 None None] SCRIPT_NAME: `/identity` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:06:13.090931 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f70a18-64ba-4cfe-ac9e-75921283f3f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:06:13.111319 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.auth.core [None req-39f70a18-64ba-4cfe-ac9e-75921283f3f6 None None] MFA Rules not processed for user `819d41a279e64291acc60de51e1530ae`. Rule list: `[]` (Enabled: `True`). {{(pid=88551) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 19:06:13.112205 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.common.fernet_utils [None req-39f70a18-64ba-4cfe-ac9e-75921283f3f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:06:13.146636 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: [pid: 88550|app: 0|req: 224/431] 10.222.0.26 () {58 vars in 1282 bytes} [Wed Aug 17 19:06:12 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 366 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 17 19:06:13.150254 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd633c92-a86b-4a19-a151-bf66e292a890 None None] REQUEST_METHOD: `GET` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:06:13.150638 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd633c92-a86b-4a19-a151-bf66e292a890 None None] SCRIPT_NAME: `/identity` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:06:13.150831 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd633c92-a86b-4a19-a151-bf66e292a890 None None] PATH_INFO: `/` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:06:13.152209 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: [pid: 88550|app: 0|req: 225/432] 10.222.0.26 () {54 vars in 927 bytes} [Wed Aug 17 19:06:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 17 19:06:13.153486 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd633c92-a86b-4a19-a151-bf66e292a890 None None] Authenticating user token {{(pid=88550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:06:13.178879 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG dbcounter [-] [88551] Writing DB stats keystone:SELECT=100 {{(pid=88551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:06:13.190167 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: [pid: 88551|app: 0|req: 208/433] 10.222.0.26 () {58 vars in 1024 bytes} [Wed Aug 17 19:06:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 17 19:06:13.195948 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82837c52-6717-40e9-97eb-7f066a2d71dc None None] REQUEST_METHOD: `POST` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:06:13.197742 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82837c52-6717-40e9-97eb-7f066a2d71dc None None] SCRIPT_NAME: `/identity` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:06:13.197742 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82837c52-6717-40e9-97eb-7f066a2d71dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:06:13.198976 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG dbcounter [-] [88550] Writing DB stats keystone:SELECT=100 {{(pid=88550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:06:13.238624 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.auth.core [None req-82837c52-6717-40e9-97eb-7f066a2d71dc None None] MFA Rules not processed for user `819d41a279e64291acc60de51e1530ae`. Rule list: `[]` (Enabled: `True`). {{(pid=88551) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 19:06:13.239944 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.common.fernet_utils [None req-82837c52-6717-40e9-97eb-7f066a2d71dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:06:13.286179 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd633c92-a86b-4a19-a151-bf66e292a890 None None] Validating token access rules against request {{(pid=88550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:06:13.333214 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a44a42c-2ebe-4e1e-b136-0d0b4194c58b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '819d41a279e64291acc60de51e1530ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:06:13.334054 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a44a42c-2ebe-4e1e-b136-0d0b4194c58b None admin] REQUEST_METHOD: `GET` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:06:13.334338 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a44a42c-2ebe-4e1e-b136-0d0b4194c58b None admin] SCRIPT_NAME: `/identity` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:06:13.334745 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a44a42c-2ebe-4e1e-b136-0d0b4194c58b None admin] PATH_INFO: `/v3/projects/4ebe56b7d67e4584afee4a218097f2b4` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:06:13.335893 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a44a42c-2ebe-4e1e-b136-0d0b4194c58b None admin] RBAC: Authorizing `identity:get_project(project_id=4ebe56b7d67e4584afee4a218097f2b4)` {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:06:13.336271 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: [pid: 88551|app: 0|req: 209/434] 10.222.0.26 () {58 vars in 1024 bytes} [Wed Aug 17 19:06:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 17 19:06:13.337223 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82837c52-6717-40e9-97eb-7f066a2d71dc None None] Authenticating user token {{(pid=88551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:06:13.337505 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a44a42c-2ebe-4e1e-b136-0d0b4194c58b None admin] RBAC: Authorization granted {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:06:13.339484 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: [pid: 88550|app: 0|req: 226/435] 10.222.0.26 () {56 vars in 1186 bytes} [Wed Aug 17 19:06:13 2022] GET /identity/v3/projects/4ebe56b7d67e4584afee4a218097f2b4 => generated 302 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 19:06:13.345236 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a44a42c-2ebe-4e1e-b136-0d0b4194c58b None admin] Authenticating user token {{(pid=88550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:06:13.462343 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG dbcounter [-] [88550] Writing DB stats keystone:SELECT=100 {{(pid=88550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:06:13.466505 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82837c52-6717-40e9-97eb-7f066a2d71dc None None] Validating token access rules against request {{(pid=88551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:06:13.468971 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a44a42c-2ebe-4e1e-b136-0d0b4194c58b None admin] Validating token access rules against request {{(pid=88550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:06:13.485553 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG dbcounter [-] [88551] Writing DB stats keystone:SELECT=100 {{(pid=88551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:06:13.504223 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8191cb3-b604-4d3f-9f75-af5460717e64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '819d41a279e64291acc60de51e1530ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:06:13.504714 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-228410a7-bbc7-4d51-b6d1-c566d5142bea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '819d41a279e64291acc60de51e1530ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:06:13.504831 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8191cb3-b604-4d3f-9f75-af5460717e64 None admin] REQUEST_METHOD: `GET` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:06:13.505112 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8191cb3-b604-4d3f-9f75-af5460717e64 None admin] SCRIPT_NAME: `/identity` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:06:13.505352 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-228410a7-bbc7-4d51-b6d1-c566d5142bea None admin] REQUEST_METHOD: `GET` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:06:13.505466 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8191cb3-b604-4d3f-9f75-af5460717e64 None admin] PATH_INFO: `/v3/roles/member` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:06:13.505636 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-228410a7-bbc7-4d51-b6d1-c566d5142bea None admin] SCRIPT_NAME: `/identity` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:06:13.505912 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-228410a7-bbc7-4d51-b6d1-c566d5142bea None admin] PATH_INFO: `/v3/groups/075b91f7cf344f048495ae57f2301231` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:06:13.507504 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-228410a7-bbc7-4d51-b6d1-c566d5142bea None admin] RBAC: Authorizing `identity:get_group(group_id=075b91f7cf344f048495ae57f2301231)` {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:06:13.509002 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-228410a7-bbc7-4d51-b6d1-c566d5142bea None admin] RBAC: Authorization granted {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:06:13.515715 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: [pid: 88550|app: 0|req: 227/436] 10.222.0.26 () {56 vars in 1180 bytes} [Wed Aug 17 19:06:13 2022] GET /identity/v3/groups/075b91f7cf344f048495ae57f2301231 => generated 226 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 19:06:13.516200 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8191cb3-b604-4d3f-9f75-af5460717e64 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 17 19:06:13.516715 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-228410a7-bbc7-4d51-b6d1-c566d5142bea None admin] Authenticating user token {{(pid=88550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:06:13.520927 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application [None req-d8191cb3-b604-4d3f-9f75-af5460717e64 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 17 19:06:13.520927 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 19:06:13.520927 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 19:06:13.520927 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 19:06:13.520927 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 19:06:13.520927 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 19:06:13.520927 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 19:06:13.520927 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 19:06:13.520927 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 19:06:13.520927 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 19:06:13.520927 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 19:06:13.520927 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 19:06:13.520927 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 17 19:06:13.520927 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 17 19:06:13.520927 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 17 19:06:13.520927 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 17 19:06:13.521829 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 17 19:06:13.521829 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 17 19:06:13.521829 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 17 19:06:13.521829 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 17 19:06:13.521829 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 19:06:13.521829 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 19:06:13.521829 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 19:06:13.521829 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 19:06:13.521829 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 19:06:13.521829 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 19:06:13.521829 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 19:06:13.521829 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application with Lock( Aug 17 19:06:13.521829 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 19:06:13.521829 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application return self._enter() Aug 17 19:06:13.521829 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 19:06:13.521829 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 19:06:13.522662 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 19:06:13.522662 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application return self.creator() Aug 17 19:06:13.522662 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 19:06:13.522662 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application created_value = creator( Aug 17 19:06:13.522662 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 17 19:06:13.522662 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 17 19:06:13.522662 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 17 19:06:13.522662 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 17 19:06:13.522662 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 17 19:06:13.522662 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 17 19:06:13.522662 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 17 19:06:13.522662 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application Aug 17 19:06:13.522662 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: [pid: 88551|app: 0|req: 210/437] 10.222.0.26 () {56 vars in 1099 bytes} [Wed Aug 17 19:06:13 2022] GET /identity/v3/roles/member => generated 84 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 19:06:13.529789 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8191cb3-b604-4d3f-9f75-af5460717e64 None admin] Authenticating user token {{(pid=88551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:06:13.628855 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-228410a7-bbc7-4d51-b6d1-c566d5142bea None admin] Validating token access rules against request {{(pid=88550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:06:13.652256 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8191cb3-b604-4d3f-9f75-af5460717e64 None admin] Validating token access rules against request {{(pid=88551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:06:13.664978 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef68ec43-dad8-4ce4-9bb9-054631f863e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '819d41a279e64291acc60de51e1530ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:06:13.665592 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef68ec43-dad8-4ce4-9bb9-054631f863e4 None admin] REQUEST_METHOD: `GET` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:06:13.665877 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef68ec43-dad8-4ce4-9bb9-054631f863e4 None admin] SCRIPT_NAME: `/identity` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:06:13.666152 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef68ec43-dad8-4ce4-9bb9-054631f863e4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:06:13.666907 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef68ec43-dad8-4ce4-9bb9-054631f863e4 None admin] RBAC: Adding query filter params (group.id=075b91f7cf344f048495ae57f2301231, role.id=748773430faa4030989e1e77b3f361e1, scope.project.id=4ebe56b7d67e4584afee4a218097f2b4) {{(pid=88550) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 19:06:13.667220 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef68ec43-dad8-4ce4-9bb9-054631f863e4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:06:13.668660 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef68ec43-dad8-4ce4-9bb9-054631f863e4 None admin] RBAC: Authorization granted {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:06:13.682991 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: [pid: 88550|app: 0|req: 228/438] 10.222.0.26 () {56 vars in 1376 bytes} [Wed Aug 17 19:06:13 2022] GET /identity/v3/role_assignments?group.id=075b91f7cf344f048495ae57f2301231&scope.project.id=4ebe56b7d67e4584afee4a218097f2b4&role.id=748773430faa4030989e1e77b3f361e1 => generated 611 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 19:06:13.682991 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef68ec43-dad8-4ce4-9bb9-054631f863e4 None admin] Authenticating user token {{(pid=88550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:06:13.698906 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb6b5ade-ba65-46e1-a471-ec8b3c422afa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '819d41a279e64291acc60de51e1530ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:06:13.699691 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb6b5ade-ba65-46e1-a471-ec8b3c422afa None admin] REQUEST_METHOD: `GET` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:06:13.699864 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb6b5ade-ba65-46e1-a471-ec8b3c422afa None admin] SCRIPT_NAME: `/identity` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:06:13.700211 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb6b5ade-ba65-46e1-a471-ec8b3c422afa None admin] PATH_INFO: `/v3/roles` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:06:13.700734 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb6b5ade-ba65-46e1-a471-ec8b3c422afa None admin] RBAC: Adding query filter params (name=member) {{(pid=88551) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 19:06:13.701032 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb6b5ade-ba65-46e1-a471-ec8b3c422afa None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:06:13.703242 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb6b5ade-ba65-46e1-a471-ec8b3c422afa None admin] RBAC: Authorization granted {{(pid=88551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:06:13.709323 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG dbcounter [-] [88550] Writing DB stats keystone:SELECT=100 {{(pid=88550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:06:13.714433 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: [pid: 88551|app: 0|req: 211/439] 10.222.0.26 () {56 vars in 1101 bytes} [Wed Aug 17 19:06:13 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 19:06:13.715240 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb6b5ade-ba65-46e1-a471-ec8b3c422afa None admin] Authenticating user token {{(pid=88551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:06:13.763680 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG dbcounter [-] [88551] Writing DB stats keystone:SELECT=100 {{(pid=88551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:06:13.799901 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef68ec43-dad8-4ce4-9bb9-054631f863e4 None admin] Validating token access rules against request {{(pid=88550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:06:13.840645 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80eae6e4-5598-4ae0-9b4a-10a4b62c3993 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '819d41a279e64291acc60de51e1530ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:06:13.841293 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80eae6e4-5598-4ae0-9b4a-10a4b62c3993 None admin] REQUEST_METHOD: `GET` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:06:13.841570 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80eae6e4-5598-4ae0-9b4a-10a4b62c3993 None admin] SCRIPT_NAME: `/identity` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:06:13.841840 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80eae6e4-5598-4ae0-9b4a-10a4b62c3993 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:06:13.841971 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb6b5ade-ba65-46e1-a471-ec8b3c422afa None admin] Validating token access rules against request {{(pid=88551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:06:13.855551 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80eae6e4-5598-4ae0-9b4a-10a4b62c3993 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 17 19:06:13.860948 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application [None req-80eae6e4-5598-4ae0-9b4a-10a4b62c3993 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 17 19:06:13.860948 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 19:06:13.860948 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 19:06:13.860948 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 19:06:13.860948 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 19:06:13.860948 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 19:06:13.860948 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 19:06:13.860948 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 19:06:13.860948 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 19:06:13.860948 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 19:06:13.860948 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 19:06:13.860948 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 19:06:13.860948 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 17 19:06:13.860948 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 17 19:06:13.860948 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 17 19:06:13.860948 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 17 19:06:13.862425 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 17 19:06:13.862425 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 17 19:06:13.862425 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 17 19:06:13.862425 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 17 19:06:13.862425 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 19:06:13.862425 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 19:06:13.862425 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 19:06:13.862425 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 19:06:13.862425 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 19:06:13.862425 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 19:06:13.862425 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 19:06:13.862425 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application with Lock( Aug 17 19:06:13.862425 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 19:06:13.862425 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return self._enter() Aug 17 19:06:13.862425 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 19:06:13.862425 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 19:06:13.863840 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 19:06:13.863840 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return self.creator() Aug 17 19:06:13.863840 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 19:06:13.863840 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application created_value = creator( Aug 17 19:06:13.863840 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 17 19:06:13.863840 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 17 19:06:13.863840 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 17 19:06:13.863840 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 17 19:06:13.863840 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 17 19:06:13.863840 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 17 19:06:13.863840 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 17 19:06:13.863840 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application Aug 17 19:06:13.863840 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: [pid: 88550|app: 0|req: 229/440] 10.222.0.26 () {56 vars in 1114 bytes} [Wed Aug 17 19:06:13 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 19:06:13.866076 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80eae6e4-5598-4ae0-9b4a-10a4b62c3993 None admin] Authenticating user token {{(pid=88550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:06:13.891902 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d586c2fb-8c0f-40e7-9698-c52f97fe804d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '819d41a279e64291acc60de51e1530ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:06:13.892646 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d586c2fb-8c0f-40e7-9698-c52f97fe804d None admin] REQUEST_METHOD: `GET` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:06:13.892987 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d586c2fb-8c0f-40e7-9698-c52f97fe804d None admin] SCRIPT_NAME: `/identity` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:06:13.893326 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d586c2fb-8c0f-40e7-9698-c52f97fe804d None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:06:13.906863 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d586c2fb-8c0f-40e7-9698-c52f97fe804d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 17 19:06:13.912016 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application [None req-d586c2fb-8c0f-40e7-9698-c52f97fe804d None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 17 19:06:13.912016 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 19:06:13.912016 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 19:06:13.912016 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 19:06:13.912016 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 19:06:13.912016 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 19:06:13.912016 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 19:06:13.912016 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 19:06:13.912016 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 19:06:13.912016 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 19:06:13.912016 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 19:06:13.912016 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 19:06:13.912016 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 17 19:06:13.912016 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 17 19:06:13.912016 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 17 19:06:13.912016 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 17 19:06:13.913002 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 17 19:06:13.913002 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 17 19:06:13.913002 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 17 19:06:13.913002 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 17 19:06:13.913002 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 19:06:13.913002 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 19:06:13.913002 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 19:06:13.913002 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 19:06:13.913002 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 19:06:13.913002 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 19:06:13.913002 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 19:06:13.913002 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application with Lock( Aug 17 19:06:13.913002 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 19:06:13.913002 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application return self._enter() Aug 17 19:06:13.913002 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 19:06:13.913002 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 19:06:13.914018 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 19:06:13.914018 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application return self.creator() Aug 17 19:06:13.914018 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 19:06:13.914018 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application created_value = creator( Aug 17 19:06:13.914018 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 17 19:06:13.914018 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 17 19:06:13.914018 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 17 19:06:13.914018 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 17 19:06:13.914018 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 17 19:06:13.914018 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 17 19:06:13.914018 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 17 19:06:13.914018 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application Aug 17 19:06:13.914018 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: [pid: 88551|app: 0|req: 212/441] 10.222.0.26 () {56 vars in 1096 bytes} [Wed Aug 17 19:06:13 2022] GET /identity/v3/roles/admin => generated 83 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 19:06:13.914913 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d586c2fb-8c0f-40e7-9698-c52f97fe804d None admin] Authenticating user token {{(pid=88551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:06:13.978777 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG dbcounter [-] [88550] Writing DB stats keystone:SELECT=100 {{(pid=88550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:06:14.002776 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80eae6e4-5598-4ae0-9b4a-10a4b62c3993 None admin] Validating token access rules against request {{(pid=88550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:06:14.031732 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG dbcounter [-] [88551] Writing DB stats keystone:SELECT=100 {{(pid=88551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:06:14.035000 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d586c2fb-8c0f-40e7-9698-c52f97fe804d None admin] Validating token access rules against request {{(pid=88551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:06:14.046961 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13986c58-58d7-42d6-90b0-47faedbb51c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '819d41a279e64291acc60de51e1530ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:06:14.047576 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13986c58-58d7-42d6-90b0-47faedbb51c9 None admin] REQUEST_METHOD: `GET` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:06:14.047943 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13986c58-58d7-42d6-90b0-47faedbb51c9 None admin] SCRIPT_NAME: `/identity` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:06:14.048173 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13986c58-58d7-42d6-90b0-47faedbb51c9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:06:14.072678 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a365b318-c703-4d0c-8b84-f7216d639262 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '819d41a279e64291acc60de51e1530ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:06:14.073442 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a365b318-c703-4d0c-8b84-f7216d639262 None admin] REQUEST_METHOD: `GET` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:06:14.073919 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a365b318-c703-4d0c-8b84-f7216d639262 None admin] SCRIPT_NAME: `/identity` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:06:14.074272 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a365b318-c703-4d0c-8b84-f7216d639262 None admin] PATH_INFO: `/v3/roles` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:06:14.074989 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a365b318-c703-4d0c-8b84-f7216d639262 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=88551) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 19:06:14.075293 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a365b318-c703-4d0c-8b84-f7216d639262 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:06:14.076697 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a365b318-c703-4d0c-8b84-f7216d639262 None admin] RBAC: Authorization granted {{(pid=88551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:06:14.090749 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: [pid: 88551|app: 0|req: 213/442] 10.222.0.26 () {56 vars in 1111 bytes} [Wed Aug 17 19:06:13 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 19:06:14.090749 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a365b318-c703-4d0c-8b84-f7216d639262 None admin] Authenticating user token {{(pid=88551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:06:14.119838 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13986c58-58d7-42d6-90b0-47faedbb51c9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:06:14.121335 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13986c58-58d7-42d6-90b0-47faedbb51c9 None admin] RBAC: Authorization granted {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:06:14.195851 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a365b318-c703-4d0c-8b84-f7216d639262 None admin] Validating token access rules against request {{(pid=88551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:06:14.210033 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG dbcounter [-] [88550] Writing DB stats keystone:SELECT=100 {{(pid=88550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:06:14.226993 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: [pid: 88550|app: 0|req: 230/443] 10.222.0.26 () {58 vars in 1282 bytes} [Wed Aug 17 19:06:13 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 363 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 17 19:06:14.231964 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13986c58-58d7-42d6-90b0-47faedbb51c9 None admin] Authenticating user token {{(pid=88550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:06:14.235209 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33d4c5e0-68ff-4560-8573-8cfd7b8bf5e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '819d41a279e64291acc60de51e1530ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:06:14.235820 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d4c5e0-68ff-4560-8573-8cfd7b8bf5e6 None admin] REQUEST_METHOD: `GET` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:06:14.236107 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d4c5e0-68ff-4560-8573-8cfd7b8bf5e6 None admin] SCRIPT_NAME: `/identity` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:06:14.236379 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d4c5e0-68ff-4560-8573-8cfd7b8bf5e6 None admin] PATH_INFO: `/v3/roles` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:06:14.237056 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33d4c5e0-68ff-4560-8573-8cfd7b8bf5e6 None admin] RBAC: Adding query filter params (name=admin) {{(pid=88551) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 19:06:14.237450 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33d4c5e0-68ff-4560-8573-8cfd7b8bf5e6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:06:14.238853 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33d4c5e0-68ff-4560-8573-8cfd7b8bf5e6 None admin] RBAC: Authorization granted {{(pid=88551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:06:14.247688 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: [pid: 88551|app: 0|req: 214/444] 10.222.0.26 () {56 vars in 1099 bytes} [Wed Aug 17 19:06:14 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 19:06:14.248515 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33d4c5e0-68ff-4560-8573-8cfd7b8bf5e6 None admin] Authenticating user token {{(pid=88551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:06:14.289721 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG dbcounter [-] [88551] Writing DB stats keystone:SELECT=100 {{(pid=88551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:06:14.358720 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13986c58-58d7-42d6-90b0-47faedbb51c9 None admin] Validating token access rules against request {{(pid=88550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:06:14.380868 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33d4c5e0-68ff-4560-8573-8cfd7b8bf5e6 None admin] Validating token access rules against request {{(pid=88551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:06:14.397238 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4389984b-a75d-4036-a728-d895fe1aabe3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '819d41a279e64291acc60de51e1530ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:06:14.397864 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4389984b-a75d-4036-a728-d895fe1aabe3 None admin] REQUEST_METHOD: `GET` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:06:14.398144 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4389984b-a75d-4036-a728-d895fe1aabe3 None admin] SCRIPT_NAME: `/identity` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:06:14.398423 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4389984b-a75d-4036-a728-d895fe1aabe3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:06:14.423070 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bb2f368-4e26-4bd2-9795-74ba51665e39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '819d41a279e64291acc60de51e1530ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:06:14.423704 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb2f368-4e26-4bd2-9795-74ba51665e39 None admin] REQUEST_METHOD: `GET` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:06:14.423986 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb2f368-4e26-4bd2-9795-74ba51665e39 None admin] SCRIPT_NAME: `/identity` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:06:14.424259 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb2f368-4e26-4bd2-9795-74ba51665e39 None admin] PATH_INFO: `/v3/projects/143eeb5624b2449582a0739926bcb8e1` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:06:14.425420 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bb2f368-4e26-4bd2-9795-74ba51665e39 None admin] RBAC: Authorizing `identity:get_project(project_id=143eeb5624b2449582a0739926bcb8e1)` {{(pid=88551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:06:14.426880 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bb2f368-4e26-4bd2-9795-74ba51665e39 None admin] RBAC: Authorization granted {{(pid=88551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:06:14.428547 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: [pid: 88551|app: 0|req: 215/445] 10.222.0.26 () {56 vars in 1186 bytes} [Wed Aug 17 19:06:14 2022] GET /identity/v3/projects/143eeb5624b2449582a0739926bcb8e1 => generated 298 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 19:06:14.430618 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bb2f368-4e26-4bd2-9795-74ba51665e39 None admin] Authenticating user token {{(pid=88551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:06:14.464353 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG dbcounter [-] [88550] Writing DB stats keystone:SELECT=100 {{(pid=88550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:06:14.477982 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4389984b-a75d-4036-a728-d895fe1aabe3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:06:14.479693 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4389984b-a75d-4036-a728-d895fe1aabe3 None admin] RBAC: Authorization granted {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:06:14.528723 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG dbcounter [-] [88551] Writing DB stats keystone:SELECT=100 {{(pid=88551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:06:14.537756 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bb2f368-4e26-4bd2-9795-74ba51665e39 None admin] Validating token access rules against request {{(pid=88551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:06:14.572745 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e4856a4-92b7-49d4-bdf8-e4a97ee49474 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '819d41a279e64291acc60de51e1530ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:06:14.573340 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e4856a4-92b7-49d4-bdf8-e4a97ee49474 None admin] REQUEST_METHOD: `GET` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:06:14.573616 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e4856a4-92b7-49d4-bdf8-e4a97ee49474 None admin] SCRIPT_NAME: `/identity` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:06:14.573891 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e4856a4-92b7-49d4-bdf8-e4a97ee49474 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:06:14.583241 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: [pid: 88550|app: 0|req: 231/446] 10.222.0.26 () {58 vars in 1282 bytes} [Wed Aug 17 19:06:14 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 356 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 17 19:06:14.584423 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4389984b-a75d-4036-a728-d895fe1aabe3 None admin] Authenticating user token {{(pid=88550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:06:14.644764 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e4856a4-92b7-49d4-bdf8-e4a97ee49474 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:06:14.646255 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e4856a4-92b7-49d4-bdf8-e4a97ee49474 None admin] RBAC: Authorization granted {{(pid=88551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:06:14.668832 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG dbcounter [-] [88550] Writing DB stats keystone:SELECT=100 {{(pid=88550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:06:14.683774 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4389984b-a75d-4036-a728-d895fe1aabe3 None admin] Validating token access rules against request {{(pid=88550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:06:14.718325 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61bc1799-6cc1-405c-a17a-23fe7e79cc1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '819d41a279e64291acc60de51e1530ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:06:14.718976 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61bc1799-6cc1-405c-a17a-23fe7e79cc1c None admin] REQUEST_METHOD: `GET` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:06:14.719256 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61bc1799-6cc1-405c-a17a-23fe7e79cc1c None admin] SCRIPT_NAME: `/identity` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:06:14.719527 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61bc1799-6cc1-405c-a17a-23fe7e79cc1c None admin] PATH_INFO: `/v3/groups/075b91f7cf344f048495ae57f2301231` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:06:14.720637 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61bc1799-6cc1-405c-a17a-23fe7e79cc1c None admin] RBAC: Authorizing `identity:get_group(group_id=075b91f7cf344f048495ae57f2301231)` {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:06:14.722515 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61bc1799-6cc1-405c-a17a-23fe7e79cc1c None admin] RBAC: Authorization granted {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:06:14.723719 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: [pid: 88550|app: 0|req: 232/447] 10.222.0.26 () {56 vars in 1180 bytes} [Wed Aug 17 19:06:14 2022] GET /identity/v3/groups/075b91f7cf344f048495ae57f2301231 => generated 226 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 19:06:14.724475 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61bc1799-6cc1-405c-a17a-23fe7e79cc1c None admin] Authenticating user token {{(pid=88550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:06:14.749946 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG dbcounter [-] [88551] Writing DB stats keystone:SELECT=100 {{(pid=88551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:06:14.762221 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: [pid: 88551|app: 0|req: 216/448] 10.222.0.26 () {58 vars in 1282 bytes} [Wed Aug 17 19:06:14 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 333 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 17 19:06:14.763128 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e4856a4-92b7-49d4-bdf8-e4a97ee49474 None admin] Authenticating user token {{(pid=88551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:06:14.849495 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61bc1799-6cc1-405c-a17a-23fe7e79cc1c None admin] Validating token access rules against request {{(pid=88550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:06:14.865144 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e4856a4-92b7-49d4-bdf8-e4a97ee49474 None admin] Validating token access rules against request {{(pid=88551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:06:14.882366 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ab49ba2-bf30-4a24-9081-65b2d49540a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '819d41a279e64291acc60de51e1530ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:06:14.883009 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab49ba2-bf30-4a24-9081-65b2d49540a8 None admin] REQUEST_METHOD: `GET` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:06:14.883283 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab49ba2-bf30-4a24-9081-65b2d49540a8 None admin] SCRIPT_NAME: `/identity` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:06:14.883550 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab49ba2-bf30-4a24-9081-65b2d49540a8 None admin] PATH_INFO: `/v3/projects/4ebe56b7d67e4584afee4a218097f2b4` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:06:14.884644 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ab49ba2-bf30-4a24-9081-65b2d49540a8 None admin] RBAC: Authorizing `identity:get_project(project_id=4ebe56b7d67e4584afee4a218097f2b4)` {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:06:14.886077 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ab49ba2-bf30-4a24-9081-65b2d49540a8 None admin] RBAC: Authorization granted {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:06:14.887701 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: [pid: 88550|app: 0|req: 233/449] 10.222.0.26 () {56 vars in 1186 bytes} [Wed Aug 17 19:06:14 2022] GET /identity/v3/projects/4ebe56b7d67e4584afee4a218097f2b4 => generated 302 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 19:06:14.888446 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ab49ba2-bf30-4a24-9081-65b2d49540a8 None admin] Authenticating user token {{(pid=88550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:06:14.899120 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75fe1863-0096-4d8f-b028-fe24baeb6e43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '819d41a279e64291acc60de51e1530ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:06:14.899717 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75fe1863-0096-4d8f-b028-fe24baeb6e43 None admin] REQUEST_METHOD: `GET` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:06:14.899994 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75fe1863-0096-4d8f-b028-fe24baeb6e43 None admin] SCRIPT_NAME: `/identity` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:06:14.900261 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75fe1863-0096-4d8f-b028-fe24baeb6e43 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:06:14.900989 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75fe1863-0096-4d8f-b028-fe24baeb6e43 None admin] RBAC: Adding query filter params (group.id=075b91f7cf344f048495ae57f2301231, role.id=748773430faa4030989e1e77b3f361e1, scope.project.id=143eeb5624b2449582a0739926bcb8e1) {{(pid=88551) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 19:06:14.901296 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75fe1863-0096-4d8f-b028-fe24baeb6e43 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:06:14.902744 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75fe1863-0096-4d8f-b028-fe24baeb6e43 None admin] RBAC: Authorization granted {{(pid=88551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:06:14.908328 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: [pid: 88551|app: 0|req: 217/450] 10.222.0.26 () {56 vars in 1376 bytes} [Wed Aug 17 19:06:14 2022] GET /identity/v3/role_assignments?group.id=075b91f7cf344f048495ae57f2301231&scope.project.id=143eeb5624b2449582a0739926bcb8e1&role.id=748773430faa4030989e1e77b3f361e1 => generated 611 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 19:06:14.909076 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75fe1863-0096-4d8f-b028-fe24baeb6e43 None admin] Authenticating user token {{(pid=88551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:06:14.918488 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG dbcounter [-] [88550] Writing DB stats keystone:SELECT=100 {{(pid=88550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:06:14.991266 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG dbcounter [-] [88551] Writing DB stats keystone:SELECT=100 {{(pid=88551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:06:15.014954 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ab49ba2-bf30-4a24-9081-65b2d49540a8 None admin] Validating token access rules against request {{(pid=88550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:06:15.042167 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75fe1863-0096-4d8f-b028-fe24baeb6e43 None admin] Validating token access rules against request {{(pid=88551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:06:15.053463 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b193de76-4d56-42a7-83c3-96123bbccbef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '819d41a279e64291acc60de51e1530ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:06:15.054257 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b193de76-4d56-42a7-83c3-96123bbccbef None admin] REQUEST_METHOD: `GET` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:06:15.054646 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b193de76-4d56-42a7-83c3-96123bbccbef None admin] SCRIPT_NAME: `/identity` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:06:15.055000 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b193de76-4d56-42a7-83c3-96123bbccbef None admin] PATH_INFO: `/v3/projects/d0490e0db9a14e81a7ea7b108a7ad6a0` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:06:15.056229 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b193de76-4d56-42a7-83c3-96123bbccbef None admin] RBAC: Authorizing `identity:get_project(project_id=d0490e0db9a14e81a7ea7b108a7ad6a0)` {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:06:15.057689 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b193de76-4d56-42a7-83c3-96123bbccbef None admin] RBAC: Authorization granted {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:06:15.059418 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: [pid: 88550|app: 0|req: 234/451] 10.222.0.26 () {56 vars in 1186 bytes} [Wed Aug 17 19:06:14 2022] GET /identity/v3/projects/d0490e0db9a14e81a7ea7b108a7ad6a0 => generated 344 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 19:06:15.066151 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b193de76-4d56-42a7-83c3-96123bbccbef None admin] Authenticating user token {{(pid=88550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:06:15.082377 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76ee526f-3009-4bf5-b5a2-713322cb60e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '819d41a279e64291acc60de51e1530ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:06:15.083126 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ee526f-3009-4bf5-b5a2-713322cb60e6 None admin] REQUEST_METHOD: `GET` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:06:15.083471 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ee526f-3009-4bf5-b5a2-713322cb60e6 None admin] SCRIPT_NAME: `/identity` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:06:15.083812 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ee526f-3009-4bf5-b5a2-713322cb60e6 None admin] PATH_INFO: `/v3/groups/075b91f7cf344f048495ae57f2301231` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:06:15.085047 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76ee526f-3009-4bf5-b5a2-713322cb60e6 None admin] RBAC: Authorizing `identity:get_group(group_id=075b91f7cf344f048495ae57f2301231)` {{(pid=88551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:06:15.086656 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76ee526f-3009-4bf5-b5a2-713322cb60e6 None admin] RBAC: Authorization granted {{(pid=88551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:06:15.093451 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: [pid: 88551|app: 0|req: 218/452] 10.222.0.26 () {56 vars in 1180 bytes} [Wed Aug 17 19:06:14 2022] GET /identity/v3/groups/075b91f7cf344f048495ae57f2301231 => generated 226 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 19:06:15.094914 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76ee526f-3009-4bf5-b5a2-713322cb60e6 None admin] Authenticating user token {{(pid=88551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:06:15.167463 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG dbcounter [-] [88550] Writing DB stats keystone:SELECT=100 {{(pid=88550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:06:15.177432 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b193de76-4d56-42a7-83c3-96123bbccbef None admin] Validating token access rules against request {{(pid=88550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:06:15.218945 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26b204d8-d607-4483-b690-8fd73d49d115 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '819d41a279e64291acc60de51e1530ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:06:15.218945 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b204d8-d607-4483-b690-8fd73d49d115 None admin] REQUEST_METHOD: `GET` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:06:15.219253 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b204d8-d607-4483-b690-8fd73d49d115 None admin] SCRIPT_NAME: `/identity` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:06:15.219463 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b204d8-d607-4483-b690-8fd73d49d115 None admin] PATH_INFO: `/v3/groups/16e76c6f45ec4715adcb2a632c7275e0` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:06:15.221359 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26b204d8-d607-4483-b690-8fd73d49d115 None admin] RBAC: Authorizing `identity:get_group(group_id=16e76c6f45ec4715adcb2a632c7275e0)` {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:06:15.222042 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26b204d8-d607-4483-b690-8fd73d49d115 None admin] RBAC: Authorization granted {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:06:15.223896 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: [pid: 88550|app: 0|req: 235/453] 10.222.0.26 () {56 vars in 1180 bytes} [Wed Aug 17 19:06:15 2022] GET /identity/v3/groups/16e76c6f45ec4715adcb2a632c7275e0 => generated 229 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 17 19:06:15.226210 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76ee526f-3009-4bf5-b5a2-713322cb60e6 None admin] Validating token access rules against request {{(pid=88551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:06:15.229601 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26b204d8-d607-4483-b690-8fd73d49d115 None admin] Authenticating user token {{(pid=88550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:06:15.256314 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG dbcounter [-] [88551] Writing DB stats keystone:SELECT=100 {{(pid=88551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:06:15.268999 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c0b7f4f-a959-40c8-ae62-dd6fa0f9e448 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '819d41a279e64291acc60de51e1530ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:06:15.272602 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c0b7f4f-a959-40c8-ae62-dd6fa0f9e448 None admin] REQUEST_METHOD: `GET` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:06:15.272602 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c0b7f4f-a959-40c8-ae62-dd6fa0f9e448 None admin] SCRIPT_NAME: `/identity` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:06:15.272602 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c0b7f4f-a959-40c8-ae62-dd6fa0f9e448 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:06:15.272602 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c0b7f4f-a959-40c8-ae62-dd6fa0f9e448 None admin] RBAC: Adding query filter params (group.id=075b91f7cf344f048495ae57f2301231, role.id=60df6490940943d3b281ddaab1b0b9f7, scope.project.id=4ebe56b7d67e4584afee4a218097f2b4) {{(pid=88551) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 19:06:15.272602 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c0b7f4f-a959-40c8-ae62-dd6fa0f9e448 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:06:15.272961 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c0b7f4f-a959-40c8-ae62-dd6fa0f9e448 None admin] RBAC: Authorization granted {{(pid=88551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:06:15.279091 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: [pid: 88551|app: 0|req: 219/454] 10.222.0.26 () {56 vars in 1376 bytes} [Wed Aug 17 19:06:15 2022] GET /identity/v3/role_assignments?group.id=075b91f7cf344f048495ae57f2301231&scope.project.id=4ebe56b7d67e4584afee4a218097f2b4&role.id=60df6490940943d3b281ddaab1b0b9f7 => generated 611 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 19:06:15.369441 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26b204d8-d607-4483-b690-8fd73d49d115 None admin] Validating token access rules against request {{(pid=88550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:06:15.415598 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc83f1c0-74b4-4d43-99f3-fb333f586789 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '819d41a279e64291acc60de51e1530ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:06:15.416426 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc83f1c0-74b4-4d43-99f3-fb333f586789 None admin] REQUEST_METHOD: `GET` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:06:15.416806 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc83f1c0-74b4-4d43-99f3-fb333f586789 None admin] SCRIPT_NAME: `/identity` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:06:15.417190 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc83f1c0-74b4-4d43-99f3-fb333f586789 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:06:15.418136 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc83f1c0-74b4-4d43-99f3-fb333f586789 None admin] RBAC: Adding query filter params (group.id=16e76c6f45ec4715adcb2a632c7275e0, role.id=204f62ae18174b60a2e3f5d4f28ea326, scope.project.id=d0490e0db9a14e81a7ea7b108a7ad6a0) {{(pid=88550) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 19:06:15.418492 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc83f1c0-74b4-4d43-99f3-fb333f586789 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:06:15.420266 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc83f1c0-74b4-4d43-99f3-fb333f586789 None admin] RBAC: Authorization granted {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:06:15.428939 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: [pid: 88550|app: 0|req: 236/455] 10.222.0.26 () {56 vars in 1376 bytes} [Wed Aug 17 19:06:15 2022] GET /identity/v3/role_assignments?group.id=16e76c6f45ec4715adcb2a632c7275e0&scope.project.id=d0490e0db9a14e81a7ea7b108a7ad6a0&role.id=204f62ae18174b60a2e3f5d4f28ea326 => generated 611 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 17 19:06:18.121044 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac27aef-c1cd-4d77-8603-96574b253231 None None] REQUEST_METHOD: `GET` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:06:18.121579 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac27aef-c1cd-4d77-8603-96574b253231 None None] SCRIPT_NAME: `/identity` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:06:18.121984 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac27aef-c1cd-4d77-8603-96574b253231 None None] PATH_INFO: `/` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:06:18.124680 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: [pid: 88551|app: 0|req: 220/456] 10.222.0.26 () {54 vars in 927 bytes} [Wed Aug 17 19:06:18 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 19:06:18.133056 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4db391e-2a30-4a7d-b765-d4abc07327a3 None None] REQUEST_METHOD: `POST` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:06:18.133529 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4db391e-2a30-4a7d-b765-d4abc07327a3 None None] SCRIPT_NAME: `/identity` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:06:18.133979 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4db391e-2a30-4a7d-b765-d4abc07327a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:06:18.166157 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.auth.core [None req-e4db391e-2a30-4a7d-b765-d4abc07327a3 None None] MFA Rules not processed for user `819d41a279e64291acc60de51e1530ae`. Rule list: `[]` (Enabled: `True`). {{(pid=88550) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 19:06:18.168220 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.common.fernet_utils [None req-e4db391e-2a30-4a7d-b765-d4abc07327a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:06:18.190915 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG dbcounter [-] [88550] Writing DB stats keystone:SELECT=100 {{(pid=88550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:06:18.243123 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: [pid: 88550|app: 0|req: 237/457] 10.222.0.26 () {58 vars in 1024 bytes} [Wed Aug 17 19:06:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 17 19:06:18.321942 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc6d39a2-8247-45a7-b4d1-3858ecb0ddb2 None None] REQUEST_METHOD: `GET` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:06:18.322279 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc6d39a2-8247-45a7-b4d1-3858ecb0ddb2 None None] SCRIPT_NAME: `/identity` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:06:18.322487 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc6d39a2-8247-45a7-b4d1-3858ecb0ddb2 None None] PATH_INFO: `/` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:06:18.324335 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: [pid: 88551|app: 0|req: 221/458] 10.222.0.26 () {54 vars in 927 bytes} [Wed Aug 17 19:06:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 19:06:18.330104 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab2c3cb0-6b81-441c-8e81-e5316e637bd5 None None] REQUEST_METHOD: `POST` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:06:18.330396 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab2c3cb0-6b81-441c-8e81-e5316e637bd5 None None] SCRIPT_NAME: `/identity` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:06:18.330715 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab2c3cb0-6b81-441c-8e81-e5316e637bd5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:06:18.351036 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.auth.core [None req-ab2c3cb0-6b81-441c-8e81-e5316e637bd5 None None] MFA Rules not processed for user `819d41a279e64291acc60de51e1530ae`. Rule list: `[]` (Enabled: `True`). {{(pid=88550) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 19:06:18.352248 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.common.fernet_utils [None req-ab2c3cb0-6b81-441c-8e81-e5316e637bd5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:06:18.423733 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: [pid: 88550|app: 0|req: 238/459] 10.222.0.26 () {58 vars in 1024 bytes} [Wed Aug 17 19:06:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 17 19:06:18.522979 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-756b2ef9-5812-452e-aa6d-59dba4188587 None None] REQUEST_METHOD: `GET` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:06:18.523170 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-756b2ef9-5812-452e-aa6d-59dba4188587 None None] SCRIPT_NAME: `/identity` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:06:18.523436 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-756b2ef9-5812-452e-aa6d-59dba4188587 None None] PATH_INFO: `/` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:06:18.524921 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: [pid: 88551|app: 0|req: 222/460] 10.222.0.26 () {54 vars in 927 bytes} [Wed Aug 17 19:06:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 19:06:18.530672 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c96da5-7f50-489e-b4b4-e0e23699d952 None None] REQUEST_METHOD: `POST` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:06:18.530964 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c96da5-7f50-489e-b4b4-e0e23699d952 None None] SCRIPT_NAME: `/identity` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:06:18.531244 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c96da5-7f50-489e-b4b4-e0e23699d952 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:06:18.549338 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.auth.core [None req-a1c96da5-7f50-489e-b4b4-e0e23699d952 None None] MFA Rules not processed for user `819d41a279e64291acc60de51e1530ae`. Rule list: `[]` (Enabled: `True`). {{(pid=88550) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 19:06:18.550530 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.common.fernet_utils [None req-a1c96da5-7f50-489e-b4b4-e0e23699d952 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:06:18.605464 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-756b2ef9-5812-452e-aa6d-59dba4188587 None None] Authenticating user token {{(pid=88551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:06:18.632487 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: [pid: 88550|app: 0|req: 239/461] 10.222.0.26 () {58 vars in 1024 bytes} [Wed Aug 17 19:06:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 17 19:06:18.721683 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-756b2ef9-5812-452e-aa6d-59dba4188587 None None] Validating token access rules against request {{(pid=88551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:06:18.760620 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeb99e3e-77e2-42ac-a888-99d3a2cbf866 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '819d41a279e64291acc60de51e1530ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:06:18.761243 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb99e3e-77e2-42ac-a888-99d3a2cbf866 None admin] REQUEST_METHOD: `GET` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:06:18.761520 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb99e3e-77e2-42ac-a888-99d3a2cbf866 None admin] SCRIPT_NAME: `/identity` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:06:18.761788 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb99e3e-77e2-42ac-a888-99d3a2cbf866 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:06:18.765577 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1c96da5-7f50-489e-b4b4-e0e23699d952 None None] Authenticating user token {{(pid=88550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:06:18.773488 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeb99e3e-77e2-42ac-a888-99d3a2cbf866 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:06:18.774955 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeb99e3e-77e2-42ac-a888-99d3a2cbf866 None admin] RBAC: Authorization granted {{(pid=88551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:06:18.781012 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG dbcounter [-] [88550] Writing DB stats keystone:SELECT=100 {{(pid=88550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:06:18.789791 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application [None req-eeb99e3e-77e2-42ac-a888-99d3a2cbf866 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 19:06:18.789791 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 19:06:18.789791 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 19:06:18.789791 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 19:06:18.789791 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 19:06:18.789791 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 19:06:18.789791 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 19:06:18.789791 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 19:06:18.789791 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 19:06:18.789791 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 19:06:18.789791 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 19:06:18.789791 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 19:06:18.789791 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 17 19:06:18.789791 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 17 19:06:18.789791 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 17 19:06:18.789791 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 17 19:06:18.790841 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 19:06:18.790841 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 19:06:18.790841 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 19:06:18.790841 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 19:06:18.790841 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 19:06:18.790841 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 19:06:18.790841 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 19:06:18.790841 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application with Lock( Aug 17 19:06:18.790841 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 19:06:18.790841 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application return self._enter() Aug 17 19:06:18.790841 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 19:06:18.790841 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 19:06:18.790841 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 19:06:18.790841 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application return self.creator() Aug 17 19:06:18.790841 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 19:06:18.790841 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application created_value = creator( Aug 17 19:06:18.790841 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 17 19:06:18.791731 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 17 19:06:18.791731 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 19:06:18.791731 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application Aug 17 19:06:18.791731 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: [pid: 88551|app: 0|req: 223/462] 10.222.0.26 () {56 vars in 1108 bytes} [Wed Aug 17 19:06:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 19:06:18.797648 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeb99e3e-77e2-42ac-a888-99d3a2cbf866 None admin] Authenticating user token {{(pid=88551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:06:18.847441 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG dbcounter [-] [88551] Writing DB stats keystone:SELECT=100 {{(pid=88551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:06:18.882729 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1c96da5-7f50-489e-b4b4-e0e23699d952 None None] Validating token access rules against request {{(pid=88550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:06:18.921675 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2455afd-da4a-4d71-a68e-f97205a9fa42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '819d41a279e64291acc60de51e1530ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:06:18.922151 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeb99e3e-77e2-42ac-a888-99d3a2cbf866 None admin] Validating token access rules against request {{(pid=88551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:06:18.922314 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2455afd-da4a-4d71-a68e-f97205a9fa42 None admin] REQUEST_METHOD: `GET` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:06:18.922620 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2455afd-da4a-4d71-a68e-f97205a9fa42 None admin] SCRIPT_NAME: `/identity` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:06:18.922903 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2455afd-da4a-4d71-a68e-f97205a9fa42 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:06:18.936296 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2455afd-da4a-4d71-a68e-f97205a9fa42 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:06:18.937965 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2455afd-da4a-4d71-a68e-f97205a9fa42 None admin] RBAC: Authorization granted {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:06:18.961535 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application [None req-d2455afd-da4a-4d71-a68e-f97205a9fa42 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 19:06:18.961535 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 19:06:18.961535 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 19:06:18.961535 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 19:06:18.961535 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 19:06:18.961535 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 19:06:18.961535 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 19:06:18.961535 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 19:06:18.961535 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 19:06:18.961535 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 19:06:18.961535 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 19:06:18.961535 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 19:06:18.961535 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 17 19:06:18.961535 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 17 19:06:18.961535 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 17 19:06:18.961535 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 17 19:06:18.962492 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 19:06:18.962492 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 19:06:18.962492 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 19:06:18.962492 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 19:06:18.962492 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 19:06:18.962492 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 19:06:18.962492 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 19:06:18.962492 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application with Lock( Aug 17 19:06:18.962492 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 19:06:18.962492 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return self._enter() Aug 17 19:06:18.962492 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 19:06:18.962492 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 19:06:18.962492 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 19:06:18.962492 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return self.creator() Aug 17 19:06:18.962492 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 19:06:18.962492 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application created_value = creator( Aug 17 19:06:18.962492 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 17 19:06:18.969198 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 17 19:06:18.969198 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 19:06:18.969198 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application Aug 17 19:06:18.969373 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7432f47a-e056-47b7-bcf2-e7745ca6d2fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '819d41a279e64291acc60de51e1530ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:06:18.969464 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: [pid: 88550|app: 0|req: 240/463] 10.222.0.26 () {56 vars in 1108 bytes} [Wed Aug 17 19:06:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 19:06:18.969532 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7432f47a-e056-47b7-bcf2-e7745ca6d2fc None admin] REQUEST_METHOD: `GET` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:06:18.969532 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7432f47a-e056-47b7-bcf2-e7745ca6d2fc None admin] SCRIPT_NAME: `/identity` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:06:18.969532 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7432f47a-e056-47b7-bcf2-e7745ca6d2fc None admin] PATH_INFO: `/v3/domains` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:06:18.969720 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff6f04d6-774b-4837-b12d-a8cc4bdc7406 None None] REQUEST_METHOD: `GET` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:06:18.969788 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7432f47a-e056-47b7-bcf2-e7745ca6d2fc None admin] RBAC: Adding query filter params (name=Default) {{(pid=88551) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 19:06:18.969854 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff6f04d6-774b-4837-b12d-a8cc4bdc7406 None None] SCRIPT_NAME: `/identity` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:06:18.969918 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7432f47a-e056-47b7-bcf2-e7745ca6d2fc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:06:18.970069 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff6f04d6-774b-4837-b12d-a8cc4bdc7406 None None] PATH_INFO: `/` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:06:18.970140 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7432f47a-e056-47b7-bcf2-e7745ca6d2fc None admin] RBAC: Authorization granted {{(pid=88551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:06:18.970206 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: [pid: 88550|app: 0|req: 241/464] 10.222.0.26 () {54 vars in 927 bytes} [Wed Aug 17 19:06:18 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 19:06:18.970206 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff6f04d6-774b-4837-b12d-a8cc4bdc7406 None None] Authenticating user token {{(pid=88550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:06:18.982505 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: [pid: 88551|app: 0|req: 224/465] 10.222.0.26 () {56 vars in 1109 bytes} [Wed Aug 17 19:06:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 17 19:06:18.983382 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7432f47a-e056-47b7-bcf2-e7745ca6d2fc None admin] Authenticating user token {{(pid=88551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:06:19.036087 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG dbcounter [-] [88550] Writing DB stats keystone:SELECT=100 {{(pid=88550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:06:19.075131 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff6f04d6-774b-4837-b12d-a8cc4bdc7406 None None] Validating token access rules against request {{(pid=88550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:06:19.085666 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG dbcounter [-] [88551] Writing DB stats keystone:SELECT=100 {{(pid=88551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:06:19.088442 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7432f47a-e056-47b7-bcf2-e7745ca6d2fc None admin] Validating token access rules against request {{(pid=88551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:06:19.109401 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd3684f7-1c23-48ae-a62e-3ca0f12b2913 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '819d41a279e64291acc60de51e1530ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:06:19.110097 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd3684f7-1c23-48ae-a62e-3ca0f12b2913 None admin] REQUEST_METHOD: `GET` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:06:19.110474 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd3684f7-1c23-48ae-a62e-3ca0f12b2913 None admin] SCRIPT_NAME: `/identity` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:06:19.110846 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd3684f7-1c23-48ae-a62e-3ca0f12b2913 None admin] PATH_INFO: `/v3/domains` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:06:19.111502 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd3684f7-1c23-48ae-a62e-3ca0f12b2913 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88550) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 19:06:19.111805 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd3684f7-1c23-48ae-a62e-3ca0f12b2913 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:06:19.113242 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd3684f7-1c23-48ae-a62e-3ca0f12b2913 None admin] RBAC: Authorization granted {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:06:19.122373 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5076e22-c69c-4f38-8e32-962206748fea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '819d41a279e64291acc60de51e1530ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:06:19.123019 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5076e22-c69c-4f38-8e32-962206748fea None admin] REQUEST_METHOD: `GET` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:06:19.123813 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5076e22-c69c-4f38-8e32-962206748fea None admin] SCRIPT_NAME: `/identity` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:06:19.124084 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5076e22-c69c-4f38-8e32-962206748fea None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:06:19.131865 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: [pid: 88550|app: 0|req: 242/466] 10.222.0.26 () {56 vars in 1109 bytes} [Wed Aug 17 19:06:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 19:06:19.133449 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-087bd660-da90-4b78-9ff6-f435c5eeeca7 None None] REQUEST_METHOD: `POST` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:06:19.133988 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-087bd660-da90-4b78-9ff6-f435c5eeeca7 None None] SCRIPT_NAME: `/identity` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:06:19.134147 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-087bd660-da90-4b78-9ff6-f435c5eeeca7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:06:19.143758 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5076e22-c69c-4f38-8e32-962206748fea None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:06:19.145217 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5076e22-c69c-4f38-8e32-962206748fea None admin] RBAC: Authorization granted {{(pid=88551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:06:19.155058 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.auth.core [None req-087bd660-da90-4b78-9ff6-f435c5eeeca7 None None] MFA Rules not processed for user `819d41a279e64291acc60de51e1530ae`. Rule list: `[]` (Enabled: `True`). {{(pid=88550) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 19:06:19.156496 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.common.fernet_utils [None req-087bd660-da90-4b78-9ff6-f435c5eeeca7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:06:19.160326 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application [None req-a5076e22-c69c-4f38-8e32-962206748fea None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 19:06:19.160326 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 19:06:19.160326 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 19:06:19.160326 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 19:06:19.160326 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 19:06:19.160326 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 19:06:19.160326 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 19:06:19.160326 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 19:06:19.160326 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 19:06:19.160326 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 19:06:19.160326 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 19:06:19.160326 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 19:06:19.160326 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 17 19:06:19.160326 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 17 19:06:19.160326 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 17 19:06:19.160326 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 17 19:06:19.161244 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 19:06:19.161244 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 19:06:19.161244 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 19:06:19.161244 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 19:06:19.161244 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 19:06:19.161244 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 19:06:19.161244 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 19:06:19.161244 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application with Lock( Aug 17 19:06:19.161244 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 19:06:19.161244 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application return self._enter() Aug 17 19:06:19.161244 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 19:06:19.161244 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 19:06:19.161244 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 19:06:19.161244 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application return self.creator() Aug 17 19:06:19.161244 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 19:06:19.161244 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application created_value = creator( Aug 17 19:06:19.161244 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 17 19:06:19.162180 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 17 19:06:19.162180 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 19:06:19.162180 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application Aug 17 19:06:19.162180 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: [pid: 88551|app: 0|req: 225/467] 10.222.0.26 () {56 vars in 1108 bytes} [Wed Aug 17 19:06:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 19:06:19.162691 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5076e22-c69c-4f38-8e32-962206748fea None admin] Authenticating user token {{(pid=88551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:06:19.233820 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: [pid: 88550|app: 0|req: 243/468] 10.222.0.26 () {58 vars in 1024 bytes} [Wed Aug 17 19:06:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 17 19:06:19.234700 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-087bd660-da90-4b78-9ff6-f435c5eeeca7 None None] Authenticating user token {{(pid=88550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:06:19.273433 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5076e22-c69c-4f38-8e32-962206748fea None admin] Validating token access rules against request {{(pid=88551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:06:19.301315 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG dbcounter [-] [88550] Writing DB stats keystone:SELECT=100 {{(pid=88550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:06:19.311999 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0d3c49c-052c-4f74-b509-826b75d0d3c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '819d41a279e64291acc60de51e1530ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:06:19.315778 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d3c49c-052c-4f74-b509-826b75d0d3c0 None admin] REQUEST_METHOD: `POST` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:06:19.315778 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d3c49c-052c-4f74-b509-826b75d0d3c0 None admin] SCRIPT_NAME: `/identity` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:06:19.315778 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d3c49c-052c-4f74-b509-826b75d0d3c0 None admin] PATH_INFO: `/v3/users` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:06:19.315778 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0d3c49c-052c-4f74-b509-826b75d0d3c0 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=88551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:06:19.315778 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0d3c49c-052c-4f74-b509-826b75d0d3c0 None admin] RBAC: Authorization granted {{(pid=88551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:06:19.352158 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-087bd660-da90-4b78-9ff6-f435c5eeeca7 None None] Validating token access rules against request {{(pid=88550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:06:19.387717 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06013084-5c5b-4242-819e-df38f72a9ff2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '819d41a279e64291acc60de51e1530ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:06:19.388324 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06013084-5c5b-4242-819e-df38f72a9ff2 None admin] REQUEST_METHOD: `POST` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:06:19.388602 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06013084-5c5b-4242-819e-df38f72a9ff2 None admin] SCRIPT_NAME: `/identity` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:06:19.388897 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06013084-5c5b-4242-819e-df38f72a9ff2 None admin] PATH_INFO: `/v3/users` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:06:19.390151 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06013084-5c5b-4242-819e-df38f72a9ff2 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:06:19.391708 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06013084-5c5b-4242-819e-df38f72a9ff2 None admin] RBAC: Authorization granted {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:06:19.401208 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: [pid: 88551|app: 0|req: 226/469] 10.222.0.26 () {60 vars in 1132 bytes} [Wed Aug 17 19:06:19 2022] POST /identity/v3/users => generated 246 bytes in 239 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 19:06:19.403120 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0d3c49c-052c-4f74-b509-826b75d0d3c0 None admin] Authenticating user token {{(pid=88551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:06:19.419716 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG dbcounter [-] [88551] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:06:19.463090 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: [pid: 88550|app: 0|req: 244/470] 10.222.0.26 () {60 vars in 1132 bytes} [Wed Aug 17 19:06:19 2022] POST /identity/v3/users => generated 248 bytes in 228 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 19:06:19.540193 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0d3c49c-052c-4f74-b509-826b75d0d3c0 None admin] Validating token access rules against request {{(pid=88551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:06:19.568376 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06013084-5c5b-4242-819e-df38f72a9ff2 None admin] Authenticating user token {{(pid=88550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:06:19.591076 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5ddd652-897d-4085-a9b3-9b39bb0a9720 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '819d41a279e64291acc60de51e1530ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:06:19.591711 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ddd652-897d-4085-a9b3-9b39bb0a9720 None admin] REQUEST_METHOD: `GET` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:06:19.592021 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ddd652-897d-4085-a9b3-9b39bb0a9720 None admin] SCRIPT_NAME: `/identity` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:06:19.592302 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ddd652-897d-4085-a9b3-9b39bb0a9720 None admin] PATH_INFO: `/v3/domains` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:06:19.592986 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5ddd652-897d-4085-a9b3-9b39bb0a9720 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88551) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 19:06:19.593291 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5ddd652-897d-4085-a9b3-9b39bb0a9720 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:06:19.594771 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5ddd652-897d-4085-a9b3-9b39bb0a9720 None admin] RBAC: Authorization granted {{(pid=88551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:06:19.609685 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: [pid: 88551|app: 0|req: 227/471] 10.222.0.26 () {56 vars in 1109 bytes} [Wed Aug 17 19:06:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 19:06:19.615489 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5ddd652-897d-4085-a9b3-9b39bb0a9720 None admin] Authenticating user token {{(pid=88551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:06:19.701745 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06013084-5c5b-4242-819e-df38f72a9ff2 None admin] Validating token access rules against request {{(pid=88550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:06:19.704728 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG dbcounter [-] [88551] Writing DB stats keystone:SELECT=100 {{(pid=88551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:06:19.719852 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG dbcounter [-] [88550] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:06:19.742652 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5ddd652-897d-4085-a9b3-9b39bb0a9720 None admin] Validating token access rules against request {{(pid=88551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:06:19.745798 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-128be03f-cb74-43a5-99c5-b9d3e1fe9bdf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '819d41a279e64291acc60de51e1530ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:06:19.746625 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-128be03f-cb74-43a5-99c5-b9d3e1fe9bdf None admin] REQUEST_METHOD: `GET` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:06:19.746966 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-128be03f-cb74-43a5-99c5-b9d3e1fe9bdf None admin] SCRIPT_NAME: `/identity` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:06:19.747301 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-128be03f-cb74-43a5-99c5-b9d3e1fe9bdf None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:06:19.764217 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-128be03f-cb74-43a5-99c5-b9d3e1fe9bdf None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:06:19.765798 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-128be03f-cb74-43a5-99c5-b9d3e1fe9bdf None admin] RBAC: Authorization granted {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:06:19.783818 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application [None req-128be03f-cb74-43a5-99c5-b9d3e1fe9bdf None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 19:06:19.783818 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 19:06:19.783818 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 19:06:19.783818 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 19:06:19.783818 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 19:06:19.783818 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 19:06:19.783818 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 19:06:19.783818 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 19:06:19.783818 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 19:06:19.783818 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 19:06:19.783818 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 19:06:19.783818 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 19:06:19.783818 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 17 19:06:19.783818 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 17 19:06:19.783818 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 17 19:06:19.783818 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 17 19:06:19.784994 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 19:06:19.784994 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 19:06:19.784994 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 19:06:19.784994 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 19:06:19.784994 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 19:06:19.784994 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 19:06:19.784994 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 19:06:19.784994 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application with Lock( Aug 17 19:06:19.784994 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 19:06:19.784994 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return self._enter() Aug 17 19:06:19.784994 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 19:06:19.784994 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 19:06:19.784994 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 19:06:19.784994 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return self.creator() Aug 17 19:06:19.784994 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 19:06:19.784994 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application created_value = creator( Aug 17 19:06:19.784994 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 17 19:06:19.786032 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 17 19:06:19.786032 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 19:06:19.786032 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application Aug 17 19:06:19.786032 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: [pid: 88550|app: 0|req: 245/472] 10.222.0.26 () {56 vars in 1108 bytes} [Wed Aug 17 19:06:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 17 19:06:19.792912 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-128be03f-cb74-43a5-99c5-b9d3e1fe9bdf None admin] Authenticating user token {{(pid=88550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:06:19.796389 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a1665ea-68eb-4642-a201-5559e4415b0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '819d41a279e64291acc60de51e1530ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:06:19.797080 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a1665ea-68eb-4642-a201-5559e4415b0c None admin] REQUEST_METHOD: `POST` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:06:19.797410 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a1665ea-68eb-4642-a201-5559e4415b0c None admin] SCRIPT_NAME: `/identity` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:06:19.797788 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a1665ea-68eb-4642-a201-5559e4415b0c None admin] PATH_INFO: `/v3/users` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:06:19.804461 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a1665ea-68eb-4642-a201-5559e4415b0c None admin] RBAC: Authorizing `identity:create_user()` {{(pid=88551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:06:19.804461 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a1665ea-68eb-4642-a201-5559e4415b0c None admin] RBAC: Authorization granted {{(pid=88551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:06:19.899124 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: [pid: 88551|app: 0|req: 228/473] 10.222.0.26 () {60 vars in 1132 bytes} [Wed Aug 17 19:06:19 2022] POST /identity/v3/users => generated 248 bytes in 284 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 19:06:19.903608 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-128be03f-cb74-43a5-99c5-b9d3e1fe9bdf None admin] Validating token access rules against request {{(pid=88550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:06:19.946347 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dbaa704-272e-4ff3-9abb-ebc22482bfef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '819d41a279e64291acc60de51e1530ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:06:19.947072 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dbaa704-272e-4ff3-9abb-ebc22482bfef None admin] REQUEST_METHOD: `GET` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:06:19.947353 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dbaa704-272e-4ff3-9abb-ebc22482bfef None admin] SCRIPT_NAME: `/identity` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:06:19.948049 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dbaa704-272e-4ff3-9abb-ebc22482bfef None admin] PATH_INFO: `/v3/domains` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:06:19.948343 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dbaa704-272e-4ff3-9abb-ebc22482bfef None admin] RBAC: Adding query filter params (name=Default) {{(pid=88550) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 19:06:19.948677 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dbaa704-272e-4ff3-9abb-ebc22482bfef None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:06:19.950143 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dbaa704-272e-4ff3-9abb-ebc22482bfef None admin] RBAC: Authorization granted {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:06:19.965014 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: [pid: 88550|app: 0|req: 246/474] 10.222.0.26 () {56 vars in 1109 bytes} [Wed Aug 17 19:06:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 17 19:06:19.970507 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a1665ea-68eb-4642-a201-5559e4415b0c None admin] Authenticating user token {{(pid=88551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:06:20.103999 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a1665ea-68eb-4642-a201-5559e4415b0c None admin] Validating token access rules against request {{(pid=88551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:06:20.131764 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG dbcounter [-] [88551] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:06:20.145747 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0ac96d7-ee45-487f-b238-78d5806c003c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '819d41a279e64291acc60de51e1530ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:06:20.146355 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ac96d7-ee45-487f-b238-78d5806c003c None admin] REQUEST_METHOD: `POST` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:06:20.146691 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ac96d7-ee45-487f-b238-78d5806c003c None admin] SCRIPT_NAME: `/identity` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:06:20.146961 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ac96d7-ee45-487f-b238-78d5806c003c None admin] PATH_INFO: `/v3/users` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:06:20.147603 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0ac96d7-ee45-487f-b238-78d5806c003c None admin] RBAC: Authorizing `identity:create_user()` {{(pid=88551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:06:20.149036 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0ac96d7-ee45-487f-b238-78d5806c003c None admin] RBAC: Authorization granted {{(pid=88551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:06:20.224146 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: [pid: 88551|app: 0|req: 229/475] 10.222.0.26 () {60 vars in 1132 bytes} [Wed Aug 17 19:06:19 2022] POST /identity/v3/users => generated 249 bytes in 254 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 19:06:21.848011 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d25d7c05-a278-41db-9da4-79540d24928d None None] REQUEST_METHOD: `GET` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:06:21.848534 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d25d7c05-a278-41db-9da4-79540d24928d None None] SCRIPT_NAME: `/identity` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:06:21.848534 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d25d7c05-a278-41db-9da4-79540d24928d None None] PATH_INFO: `/` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:06:21.850174 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: [pid: 88550|app: 0|req: 247/476] 10.222.0.26 () {54 vars in 927 bytes} [Wed Aug 17 19:06:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 19:06:21.855722 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fedca230-bc63-4bfb-b62c-46f1b9d6fb38 None None] REQUEST_METHOD: `POST` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:06:21.856169 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fedca230-bc63-4bfb-b62c-46f1b9d6fb38 None None] SCRIPT_NAME: `/identity` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:06:21.856346 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fedca230-bc63-4bfb-b62c-46f1b9d6fb38 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:06:21.876631 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.auth.core [None req-fedca230-bc63-4bfb-b62c-46f1b9d6fb38 None None] MFA Rules not processed for user `819d41a279e64291acc60de51e1530ae`. Rule list: `[]` (Enabled: `True`). {{(pid=88551) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 19:06:21.877837 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.common.fernet_utils [None req-fedca230-bc63-4bfb-b62c-46f1b9d6fb38 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:06:21.915523 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e9c84d-83a2-4b06-a4cc-779afbb04828 None None] REQUEST_METHOD: `GET` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:06:21.915832 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e9c84d-83a2-4b06-a4cc-779afbb04828 None None] SCRIPT_NAME: `/identity` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:06:21.916070 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e9c84d-83a2-4b06-a4cc-779afbb04828 None None] PATH_INFO: `/` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:06:21.917969 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: [pid: 88550|app: 0|req: 248/477] 10.222.0.26 () {54 vars in 927 bytes} [Wed Aug 17 19:06:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 19:06:21.923871 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df99c545-646e-4b6d-a9c5-cee0a4e699c6 None None] REQUEST_METHOD: `POST` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:06:21.924156 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df99c545-646e-4b6d-a9c5-cee0a4e699c6 None None] SCRIPT_NAME: `/identity` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:06:21.924431 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df99c545-646e-4b6d-a9c5-cee0a4e699c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:06:21.957496 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.auth.core [None req-df99c545-646e-4b6d-a9c5-cee0a4e699c6 None None] MFA Rules not processed for user `819d41a279e64291acc60de51e1530ae`. Rule list: `[]` (Enabled: `True`). {{(pid=88550) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 19:06:21.959587 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.common.fernet_utils [None req-df99c545-646e-4b6d-a9c5-cee0a4e699c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:06:21.968010 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: [pid: 88551|app: 0|req: 230/478] 10.222.0.26 () {58 vars in 1024 bytes} [Wed Aug 17 19:06:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 17 19:06:21.979684 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG dbcounter [-] [88550] Writing DB stats keystone:SELECT=100 {{(pid=88550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:06:22.034496 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: [pid: 88550|app: 0|req: 249/479] 10.222.0.26 () {58 vars in 1024 bytes} [Wed Aug 17 19:06:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 17 19:06:22.267119 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a66ce8b9-5d5e-4d34-930f-50c2afba804c None None] REQUEST_METHOD: `GET` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:06:22.267424 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a66ce8b9-5d5e-4d34-930f-50c2afba804c None None] SCRIPT_NAME: `/identity` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:06:22.267672 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a66ce8b9-5d5e-4d34-930f-50c2afba804c None None] PATH_INFO: `/` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:06:22.269373 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: [pid: 88551|app: 0|req: 231/480] 10.222.0.26 () {54 vars in 927 bytes} [Wed Aug 17 19:06:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 19:06:22.274649 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a46370a-f136-4758-8a1b-0a9d8c635ba8 None None] REQUEST_METHOD: `POST` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:06:22.275179 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a46370a-f136-4758-8a1b-0a9d8c635ba8 None None] SCRIPT_NAME: `/identity` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:06:22.275678 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a46370a-f136-4758-8a1b-0a9d8c635ba8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:06:22.294504 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.auth.core [None req-7a46370a-f136-4758-8a1b-0a9d8c635ba8 None None] MFA Rules not processed for user `819d41a279e64291acc60de51e1530ae`. Rule list: `[]` (Enabled: `True`). {{(pid=88550) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 19:06:22.296740 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.common.fernet_utils [None req-7a46370a-f136-4758-8a1b-0a9d8c635ba8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:06:22.312044 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a66ce8b9-5d5e-4d34-930f-50c2afba804c None None] Authenticating user token {{(pid=88551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:06:22.390587 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: [pid: 88550|app: 0|req: 250/481] 10.222.0.26 () {58 vars in 1024 bytes} [Wed Aug 17 19:06:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 17 19:06:22.390587 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a46370a-f136-4758-8a1b-0a9d8c635ba8 None None] Authenticating user token {{(pid=88550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:06:22.449315 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a66ce8b9-5d5e-4d34-930f-50c2afba804c None None] Validating token access rules against request {{(pid=88551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:06:22.470188 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG dbcounter [-] [88551] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:06:22.503680 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-990b1b2d-220d-4bc1-b4ca-b70ece3dddcb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '819d41a279e64291acc60de51e1530ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:06:22.504804 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-990b1b2d-220d-4bc1-b4ca-b70ece3dddcb None admin] REQUEST_METHOD: `GET` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:06:22.505227 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-990b1b2d-220d-4bc1-b4ca-b70ece3dddcb None admin] SCRIPT_NAME: `/identity` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:06:22.506234 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG dbcounter [-] [88550] Writing DB stats keystone:SELECT=100 {{(pid=88550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:06:22.507006 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-990b1b2d-220d-4bc1-b4ca-b70ece3dddcb None admin] PATH_INFO: `/v3/roles/service` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:06:22.521884 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-990b1b2d-220d-4bc1-b4ca-b70ece3dddcb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 17 19:06:22.528536 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application [None req-990b1b2d-220d-4bc1-b4ca-b70ece3dddcb None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 17 19:06:22.528536 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 19:06:22.528536 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 19:06:22.528536 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 19:06:22.528536 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 19:06:22.528536 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 19:06:22.528536 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 19:06:22.528536 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 19:06:22.528536 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 19:06:22.528536 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 19:06:22.528536 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 19:06:22.528536 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 19:06:22.528536 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 17 19:06:22.528536 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 17 19:06:22.528536 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 17 19:06:22.528536 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 17 19:06:22.530079 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 17 19:06:22.530079 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 17 19:06:22.530079 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 17 19:06:22.530079 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 17 19:06:22.530079 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 19:06:22.530079 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 19:06:22.530079 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 19:06:22.530079 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 19:06:22.530079 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 19:06:22.530079 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 19:06:22.530079 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 19:06:22.530079 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application with Lock( Aug 17 19:06:22.530079 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 19:06:22.530079 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application return self._enter() Aug 17 19:06:22.530079 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 19:06:22.530079 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 19:06:22.530897 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 19:06:22.530897 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application return self.creator() Aug 17 19:06:22.530897 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 19:06:22.530897 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application created_value = creator( Aug 17 19:06:22.530897 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 17 19:06:22.530897 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 17 19:06:22.530897 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 17 19:06:22.530897 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 17 19:06:22.530897 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 17 19:06:22.530897 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 17 19:06:22.530897 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 17 19:06:22.530897 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application Aug 17 19:06:22.531544 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a46370a-f136-4758-8a1b-0a9d8c635ba8 None None] Validating token access rules against request {{(pid=88550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:06:22.534334 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: [pid: 88551|app: 0|req: 232/482] 10.222.0.26 () {56 vars in 1102 bytes} [Wed Aug 17 19:06:22 2022] GET /identity/v3/roles/service => generated 85 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 19:06:22.539969 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-990b1b2d-220d-4bc1-b4ca-b70ece3dddcb None admin] Authenticating user token {{(pid=88551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:06:22.619296 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b00e5cd-cf2c-4cd2-9b93-be2855f30e4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '819d41a279e64291acc60de51e1530ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:06:22.620860 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b00e5cd-cf2c-4cd2-9b93-be2855f30e4d None admin] REQUEST_METHOD: `GET` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:06:22.621384 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b00e5cd-cf2c-4cd2-9b93-be2855f30e4d None admin] SCRIPT_NAME: `/identity` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:06:22.621868 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b00e5cd-cf2c-4cd2-9b93-be2855f30e4d None admin] PATH_INFO: `/v3/roles/service` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:06:22.634364 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b00e5cd-cf2c-4cd2-9b93-be2855f30e4d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 17 19:06:22.639612 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application [None req-9b00e5cd-cf2c-4cd2-9b93-be2855f30e4d None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 17 19:06:22.639612 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 19:06:22.639612 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 19:06:22.639612 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 19:06:22.639612 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 19:06:22.639612 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 19:06:22.639612 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 19:06:22.639612 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 19:06:22.639612 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 19:06:22.639612 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 19:06:22.639612 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 19:06:22.639612 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 19:06:22.639612 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 17 19:06:22.639612 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 17 19:06:22.639612 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 17 19:06:22.639612 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 17 19:06:22.641562 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 17 19:06:22.641562 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 17 19:06:22.641562 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 17 19:06:22.641562 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 17 19:06:22.641562 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 19:06:22.641562 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 19:06:22.641562 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 19:06:22.641562 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 19:06:22.641562 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 19:06:22.641562 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 19:06:22.641562 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 19:06:22.641562 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application with Lock( Aug 17 19:06:22.641562 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 19:06:22.641562 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return self._enter() Aug 17 19:06:22.641562 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 19:06:22.641562 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 19:06:22.651495 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 19:06:22.651495 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return self.creator() Aug 17 19:06:22.651495 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 19:06:22.651495 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application created_value = creator( Aug 17 19:06:22.651495 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 17 19:06:22.651495 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 17 19:06:22.651495 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 17 19:06:22.651495 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 17 19:06:22.651495 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 17 19:06:22.651495 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 17 19:06:22.651495 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 17 19:06:22.651495 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application Aug 17 19:06:22.651495 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: [pid: 88550|app: 0|req: 251/483] 10.222.0.26 () {56 vars in 1102 bytes} [Wed Aug 17 19:06:22 2022] GET /identity/v3/roles/service => generated 85 bytes in 253 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 19:06:22.651495 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9392b3aa-a2e7-48c0-816d-e7da0ea23a8e None None] REQUEST_METHOD: `GET` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:06:22.652390 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9392b3aa-a2e7-48c0-816d-e7da0ea23a8e None None] SCRIPT_NAME: `/identity` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:06:22.652390 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9392b3aa-a2e7-48c0-816d-e7da0ea23a8e None None] PATH_INFO: `/` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:06:22.652390 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: [pid: 88550|app: 0|req: 252/484] 10.222.0.26 () {54 vars in 927 bytes} [Wed Aug 17 19:06:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 19:06:22.652390 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9392b3aa-a2e7-48c0-816d-e7da0ea23a8e None None] Authenticating user token {{(pid=88550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:06:22.707809 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-990b1b2d-220d-4bc1-b4ca-b70ece3dddcb None admin] Validating token access rules against request {{(pid=88551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:06:22.744305 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0c65623-1387-48d6-9f29-0af9b9b4b2c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '819d41a279e64291acc60de51e1530ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:06:22.744930 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c65623-1387-48d6-9f29-0af9b9b4b2c2 None admin] REQUEST_METHOD: `GET` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:06:22.745211 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c65623-1387-48d6-9f29-0af9b9b4b2c2 None admin] SCRIPT_NAME: `/identity` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:06:22.745509 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c65623-1387-48d6-9f29-0af9b9b4b2c2 None admin] PATH_INFO: `/v3/roles` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:06:22.746215 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0c65623-1387-48d6-9f29-0af9b9b4b2c2 None admin] RBAC: Adding query filter params (name=service) {{(pid=88551) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 19:06:22.746517 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0c65623-1387-48d6-9f29-0af9b9b4b2c2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:06:22.748024 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0c65623-1387-48d6-9f29-0af9b9b4b2c2 None admin] RBAC: Authorization granted {{(pid=88551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:06:22.757322 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: [pid: 88551|app: 0|req: 233/485] 10.222.0.26 () {56 vars in 1103 bytes} [Wed Aug 17 19:06:22 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 17 19:06:22.758617 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf8d393-2436-4cd6-bf04-11534630bef5 None None] REQUEST_METHOD: `POST` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:06:22.758931 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf8d393-2436-4cd6-bf04-11534630bef5 None None] SCRIPT_NAME: `/identity` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:06:22.759302 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf8d393-2436-4cd6-bf04-11534630bef5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:06:22.772511 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9392b3aa-a2e7-48c0-816d-e7da0ea23a8e None None] Validating token access rules against request {{(pid=88550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:06:22.781846 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.auth.core [None req-eaf8d393-2436-4cd6-bf04-11534630bef5 None None] MFA Rules not processed for user `819d41a279e64291acc60de51e1530ae`. Rule list: `[]` (Enabled: `True`). {{(pid=88551) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 19:06:22.787959 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.common.fernet_utils [None req-eaf8d393-2436-4cd6-bf04-11534630bef5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:06:22.811366 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG dbcounter [-] [88551] Writing DB stats keystone:SELECT=100 {{(pid=88551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:06:22.812981 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cb98f8a-567e-4dcb-83d8-ca20c673c911 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '819d41a279e64291acc60de51e1530ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:06:22.813583 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb98f8a-567e-4dcb-83d8-ca20c673c911 None admin] REQUEST_METHOD: `GET` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:06:22.813860 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb98f8a-567e-4dcb-83d8-ca20c673c911 None admin] SCRIPT_NAME: `/identity` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:06:22.814143 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb98f8a-567e-4dcb-83d8-ca20c673c911 None admin] PATH_INFO: `/v3/roles` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:06:22.814869 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cb98f8a-567e-4dcb-83d8-ca20c673c911 None admin] RBAC: Adding query filter params (name=service) {{(pid=88550) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 19:06:22.815167 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cb98f8a-567e-4dcb-83d8-ca20c673c911 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:06:22.816546 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cb98f8a-567e-4dcb-83d8-ca20c673c911 None admin] RBAC: Authorization granted {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:06:22.824993 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: [pid: 88550|app: 0|req: 253/486] 10.222.0.26 () {56 vars in 1103 bytes} [Wed Aug 17 19:06:22 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 19:06:22.825809 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cb98f8a-567e-4dcb-83d8-ca20c673c911 None admin] Authenticating user token {{(pid=88550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:06:22.832761 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG dbcounter [-] [88550] Writing DB stats keystone:SELECT=100 {{(pid=88550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:06:22.855484 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: [pid: 88551|app: 0|req: 234/487] 10.222.0.26 () {58 vars in 1024 bytes} [Wed Aug 17 19:06:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 17 19:06:22.856417 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaf8d393-2436-4cd6-bf04-11534630bef5 None None] Authenticating user token {{(pid=88551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:06:22.941953 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cb98f8a-567e-4dcb-83d8-ca20c673c911 None admin] Validating token access rules against request {{(pid=88550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:06:22.968300 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaf8d393-2436-4cd6-bf04-11534630bef5 None None] Validating token access rules against request {{(pid=88551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:06:22.978959 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f9722c5-4c2c-4e64-b6cc-5a4ca9a7ab2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '819d41a279e64291acc60de51e1530ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:06:22.979787 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f9722c5-4c2c-4e64-b6cc-5a4ca9a7ab2b None admin] REQUEST_METHOD: `GET` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:06:22.980206 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f9722c5-4c2c-4e64-b6cc-5a4ca9a7ab2b None admin] SCRIPT_NAME: `/identity` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:06:22.980607 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f9722c5-4c2c-4e64-b6cc-5a4ca9a7ab2b None admin] PATH_INFO: `/v3/roles/service` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:06:22.992206 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f9722c5-4c2c-4e64-b6cc-5a4ca9a7ab2b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 17 19:06:22.997916 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application [None req-5f9722c5-4c2c-4e64-b6cc-5a4ca9a7ab2b None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 17 19:06:22.997916 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 19:06:22.997916 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 19:06:22.997916 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 19:06:22.997916 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 19:06:22.997916 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 19:06:22.997916 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 19:06:22.997916 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 19:06:22.997916 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 19:06:22.997916 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 19:06:22.997916 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 19:06:22.997916 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 19:06:22.997916 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 17 19:06:22.997916 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 17 19:06:22.997916 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 17 19:06:22.997916 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 17 19:06:22.999184 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 17 19:06:22.999184 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 17 19:06:22.999184 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 17 19:06:22.999184 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 17 19:06:22.999184 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 19:06:22.999184 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 19:06:22.999184 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 19:06:22.999184 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 19:06:22.999184 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 19:06:22.999184 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 19:06:22.999184 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 19:06:22.999184 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application with Lock( Aug 17 19:06:22.999184 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 19:06:22.999184 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return self._enter() Aug 17 19:06:22.999184 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 19:06:22.999184 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 19:06:22.999991 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 19:06:22.999991 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return self.creator() Aug 17 19:06:22.999991 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 19:06:22.999991 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application created_value = creator( Aug 17 19:06:22.999991 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 17 19:06:22.999991 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 17 19:06:22.999991 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 17 19:06:22.999991 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 17 19:06:22.999991 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 17 19:06:22.999991 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 17 19:06:22.999991 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 17 19:06:22.999991 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application Aug 17 19:06:22.999991 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: [pid: 88550|app: 0|req: 254/488] 10.222.0.26 () {56 vars in 1102 bytes} [Wed Aug 17 19:06:22 2022] GET /identity/v3/roles/service => generated 85 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 19:06:23.000654 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f9722c5-4c2c-4e64-b6cc-5a4ca9a7ab2b None admin] Authenticating user token {{(pid=88550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:06:23.009911 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ec01bb7-8833-4e3c-b52c-15c0678e9b55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '819d41a279e64291acc60de51e1530ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:06:23.010565 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec01bb7-8833-4e3c-b52c-15c0678e9b55 None admin] REQUEST_METHOD: `GET` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:06:23.010839 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec01bb7-8833-4e3c-b52c-15c0678e9b55 None admin] SCRIPT_NAME: `/identity` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:06:23.011109 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec01bb7-8833-4e3c-b52c-15c0678e9b55 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:06:23.021632 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ec01bb7-8833-4e3c-b52c-15c0678e9b55 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:06:23.023323 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ec01bb7-8833-4e3c-b52c-15c0678e9b55 None admin] RBAC: Authorization granted {{(pid=88551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:06:23.038780 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application [None req-3ec01bb7-8833-4e3c-b52c-15c0678e9b55 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 19:06:23.038780 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 19:06:23.038780 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 19:06:23.038780 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 19:06:23.038780 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 19:06:23.038780 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 19:06:23.038780 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 19:06:23.038780 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 19:06:23.038780 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 19:06:23.038780 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 19:06:23.038780 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 19:06:23.038780 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 19:06:23.038780 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 17 19:06:23.038780 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 17 19:06:23.038780 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 17 19:06:23.038780 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 17 19:06:23.039886 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 19:06:23.039886 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 19:06:23.039886 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 19:06:23.039886 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 19:06:23.039886 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 19:06:23.039886 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 19:06:23.039886 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 19:06:23.039886 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application with Lock( Aug 17 19:06:23.039886 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 19:06:23.039886 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application return self._enter() Aug 17 19:06:23.039886 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 19:06:23.039886 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 19:06:23.039886 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 19:06:23.039886 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application return self.creator() Aug 17 19:06:23.039886 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 19:06:23.039886 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application created_value = creator( Aug 17 19:06:23.039886 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 17 19:06:23.040771 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 17 19:06:23.040771 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 19:06:23.040771 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application Aug 17 19:06:23.040771 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: [pid: 88551|app: 0|req: 235/489] 10.222.0.26 () {56 vars in 1108 bytes} [Wed Aug 17 19:06:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 19:06:23.041067 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ec01bb7-8833-4e3c-b52c-15c0678e9b55 None admin] Authenticating user token {{(pid=88551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:06:23.062663 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG dbcounter [-] [88551] Writing DB stats keystone:SELECT=100 {{(pid=88551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:06:23.074184 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG dbcounter [-] [88550] Writing DB stats keystone:SELECT=100 {{(pid=88550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:06:23.114909 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f9722c5-4c2c-4e64-b6cc-5a4ca9a7ab2b None admin] Validating token access rules against request {{(pid=88550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:06:23.152336 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34f6ab35-0a4c-44a0-ac50-fead9e8cf6a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '819d41a279e64291acc60de51e1530ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:06:23.153207 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f6ab35-0a4c-44a0-ac50-fead9e8cf6a6 None admin] REQUEST_METHOD: `GET` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:06:23.153657 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f6ab35-0a4c-44a0-ac50-fead9e8cf6a6 None admin] SCRIPT_NAME: `/identity` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:06:23.153927 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ec01bb7-8833-4e3c-b52c-15c0678e9b55 None admin] Validating token access rules against request {{(pid=88551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:06:23.154227 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f6ab35-0a4c-44a0-ac50-fead9e8cf6a6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:06:23.166116 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34f6ab35-0a4c-44a0-ac50-fead9e8cf6a6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:06:23.167806 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34f6ab35-0a4c-44a0-ac50-fead9e8cf6a6 None admin] RBAC: Authorization granted {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:06:23.182448 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application [None req-34f6ab35-0a4c-44a0-ac50-fead9e8cf6a6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 19:06:23.182448 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 19:06:23.182448 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 19:06:23.182448 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 19:06:23.182448 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 19:06:23.182448 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 19:06:23.182448 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 19:06:23.182448 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 19:06:23.182448 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 19:06:23.182448 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 19:06:23.182448 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 19:06:23.182448 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 19:06:23.182448 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 17 19:06:23.182448 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 17 19:06:23.182448 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 17 19:06:23.182448 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 17 19:06:23.183581 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 19:06:23.183581 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 19:06:23.183581 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 19:06:23.183581 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 19:06:23.183581 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 19:06:23.183581 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 19:06:23.183581 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 19:06:23.183581 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application with Lock( Aug 17 19:06:23.183581 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 19:06:23.183581 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return self._enter() Aug 17 19:06:23.183581 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 19:06:23.183581 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 19:06:23.183581 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 19:06:23.183581 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return self.creator() Aug 17 19:06:23.183581 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 19:06:23.183581 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application created_value = creator( Aug 17 19:06:23.183581 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 17 19:06:23.184610 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 17 19:06:23.184610 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 19:06:23.184610 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application Aug 17 19:06:23.186398 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: [pid: 88550|app: 0|req: 255/490] 10.222.0.26 () {56 vars in 1108 bytes} [Wed Aug 17 19:06:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 19:06:23.187236 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34f6ab35-0a4c-44a0-ac50-fead9e8cf6a6 None admin] Authenticating user token {{(pid=88550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:06:23.195370 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43a31d16-b143-4bc0-831a-43f96baf2320 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '819d41a279e64291acc60de51e1530ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:06:23.195977 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a31d16-b143-4bc0-831a-43f96baf2320 None admin] REQUEST_METHOD: `GET` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:06:23.196256 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a31d16-b143-4bc0-831a-43f96baf2320 None admin] SCRIPT_NAME: `/identity` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:06:23.196527 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a31d16-b143-4bc0-831a-43f96baf2320 None admin] PATH_INFO: `/v3/roles` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:06:23.197195 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43a31d16-b143-4bc0-831a-43f96baf2320 None admin] RBAC: Adding query filter params (name=service) {{(pid=88551) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 19:06:23.197499 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43a31d16-b143-4bc0-831a-43f96baf2320 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:06:23.198885 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43a31d16-b143-4bc0-831a-43f96baf2320 None admin] RBAC: Authorization granted {{(pid=88551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:06:23.207848 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: [pid: 88551|app: 0|req: 236/491] 10.222.0.26 () {56 vars in 1103 bytes} [Wed Aug 17 19:06:23 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 19:06:23.208682 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43a31d16-b143-4bc0-831a-43f96baf2320 None admin] Authenticating user token {{(pid=88551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:06:23.287774 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34f6ab35-0a4c-44a0-ac50-fead9e8cf6a6 None admin] Validating token access rules against request {{(pid=88550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:06:23.290740 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG dbcounter [-] [88551] Writing DB stats keystone:SELECT=100 {{(pid=88551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:06:23.304380 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG dbcounter [-] [88550] Writing DB stats keystone:SELECT=100 {{(pid=88550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:06:23.314876 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43a31d16-b143-4bc0-831a-43f96baf2320 None admin] Validating token access rules against request {{(pid=88551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:06:23.322641 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c76f96ea-76a5-4e30-acde-179101a8845a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '819d41a279e64291acc60de51e1530ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:06:23.323263 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c76f96ea-76a5-4e30-acde-179101a8845a None admin] REQUEST_METHOD: `GET` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:06:23.323550 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c76f96ea-76a5-4e30-acde-179101a8845a None admin] SCRIPT_NAME: `/identity` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:06:23.323801 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c76f96ea-76a5-4e30-acde-179101a8845a None admin] PATH_INFO: `/v3/domains` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:06:23.324453 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c76f96ea-76a5-4e30-acde-179101a8845a None admin] RBAC: Adding query filter params (name=Default) {{(pid=88550) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 19:06:23.324755 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c76f96ea-76a5-4e30-acde-179101a8845a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:06:23.326167 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c76f96ea-76a5-4e30-acde-179101a8845a None admin] RBAC: Authorization granted {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:06:23.340001 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: [pid: 88550|app: 0|req: 256/492] 10.222.0.26 () {56 vars in 1109 bytes} [Wed Aug 17 19:06:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 19:06:23.340748 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c76f96ea-76a5-4e30-acde-179101a8845a None admin] Authenticating user token {{(pid=88550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:06:23.355422 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d9c48f4-a146-469d-bc92-8caea63eee02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '819d41a279e64291acc60de51e1530ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:06:23.356077 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d9c48f4-a146-469d-bc92-8caea63eee02 None admin] REQUEST_METHOD: `GET` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:06:23.356349 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d9c48f4-a146-469d-bc92-8caea63eee02 None admin] SCRIPT_NAME: `/identity` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:06:23.356612 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d9c48f4-a146-469d-bc92-8caea63eee02 None admin] PATH_INFO: `/v3/roles/service` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:06:23.367553 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d9c48f4-a146-469d-bc92-8caea63eee02 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 17 19:06:23.372767 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application [None req-5d9c48f4-a146-469d-bc92-8caea63eee02 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 17 19:06:23.372767 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 19:06:23.372767 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 19:06:23.372767 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 19:06:23.372767 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 19:06:23.372767 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 19:06:23.372767 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 19:06:23.372767 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 19:06:23.372767 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 19:06:23.372767 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 19:06:23.372767 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 19:06:23.372767 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 19:06:23.372767 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 17 19:06:23.372767 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 17 19:06:23.372767 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 17 19:06:23.372767 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 17 19:06:23.373707 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 17 19:06:23.373707 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 17 19:06:23.373707 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 17 19:06:23.373707 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 17 19:06:23.373707 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 19:06:23.373707 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 19:06:23.373707 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 19:06:23.373707 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 19:06:23.373707 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 19:06:23.373707 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 19:06:23.373707 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 19:06:23.373707 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application with Lock( Aug 17 19:06:23.373707 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 19:06:23.373707 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application return self._enter() Aug 17 19:06:23.373707 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 19:06:23.373707 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 19:06:23.374526 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 19:06:23.374526 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application return self.creator() Aug 17 19:06:23.374526 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 19:06:23.374526 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application created_value = creator( Aug 17 19:06:23.374526 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 17 19:06:23.374526 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 17 19:06:23.374526 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 17 19:06:23.374526 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 17 19:06:23.374526 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 17 19:06:23.374526 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 17 19:06:23.374526 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 17 19:06:23.374526 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application Aug 17 19:06:23.374526 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: [pid: 88551|app: 0|req: 237/493] 10.222.0.26 () {56 vars in 1102 bytes} [Wed Aug 17 19:06:23 2022] GET /identity/v3/roles/service => generated 85 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 19:06:23.375242 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d9c48f4-a146-469d-bc92-8caea63eee02 None admin] Authenticating user token {{(pid=88551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:06:23.453087 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c76f96ea-76a5-4e30-acde-179101a8845a None admin] Validating token access rules against request {{(pid=88550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:06:23.481280 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d9c48f4-a146-469d-bc92-8caea63eee02 None admin] Validating token access rules against request {{(pid=88551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:06:23.490048 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaf5d4a8-89ac-4437-b34d-9468380088e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '819d41a279e64291acc60de51e1530ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:06:23.490683 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf5d4a8-89ac-4437-b34d-9468380088e3 None admin] REQUEST_METHOD: `GET` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:06:23.490984 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf5d4a8-89ac-4437-b34d-9468380088e3 None admin] SCRIPT_NAME: `/identity` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:06:23.491767 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf5d4a8-89ac-4437-b34d-9468380088e3 None admin] PATH_INFO: `/v3/domains` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:06:23.492055 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaf5d4a8-89ac-4437-b34d-9468380088e3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88550) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 19:06:23.492590 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaf5d4a8-89ac-4437-b34d-9468380088e3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:06:23.493534 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaf5d4a8-89ac-4437-b34d-9468380088e3 None admin] RBAC: Authorization granted {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:06:23.505542 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: [pid: 88550|app: 0|req: 257/494] 10.222.0.26 () {56 vars in 1109 bytes} [Wed Aug 17 19:06:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 19:06:23.506667 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaf5d4a8-89ac-4437-b34d-9468380088e3 None admin] Authenticating user token {{(pid=88550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:06:23.520846 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-356f8e5e-9e2a-40c9-8115-580990ed5abb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '819d41a279e64291acc60de51e1530ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:06:23.522088 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-356f8e5e-9e2a-40c9-8115-580990ed5abb None admin] REQUEST_METHOD: `GET` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:06:23.522088 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-356f8e5e-9e2a-40c9-8115-580990ed5abb None admin] SCRIPT_NAME: `/identity` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:06:23.522088 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-356f8e5e-9e2a-40c9-8115-580990ed5abb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:06:23.524763 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG dbcounter [-] [88551] Writing DB stats keystone:SELECT=100 {{(pid=88551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:06:23.543099 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG dbcounter [-] [88550] Writing DB stats keystone:SELECT=100 {{(pid=88550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:06:23.543470 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-356f8e5e-9e2a-40c9-8115-580990ed5abb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:06:23.545158 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-356f8e5e-9e2a-40c9-8115-580990ed5abb None admin] RBAC: Authorization granted {{(pid=88551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:06:23.559772 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application [None req-356f8e5e-9e2a-40c9-8115-580990ed5abb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 19:06:23.559772 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 19:06:23.559772 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 19:06:23.559772 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 19:06:23.559772 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 19:06:23.559772 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 19:06:23.559772 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 19:06:23.559772 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 19:06:23.559772 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 19:06:23.559772 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 19:06:23.559772 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 19:06:23.559772 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 19:06:23.559772 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 17 19:06:23.559772 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 17 19:06:23.559772 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 17 19:06:23.559772 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 17 19:06:23.561797 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 19:06:23.561797 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 19:06:23.561797 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 19:06:23.561797 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 19:06:23.561797 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 19:06:23.561797 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 19:06:23.561797 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 19:06:23.561797 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application with Lock( Aug 17 19:06:23.561797 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 19:06:23.561797 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application return self._enter() Aug 17 19:06:23.561797 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 19:06:23.561797 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 19:06:23.561797 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 19:06:23.561797 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application return self.creator() Aug 17 19:06:23.561797 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 19:06:23.561797 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application created_value = creator( Aug 17 19:06:23.561797 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 17 19:06:23.563259 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 17 19:06:23.563259 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 19:06:23.563259 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application Aug 17 19:06:23.563259 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: [pid: 88551|app: 0|req: 238/495] 10.222.0.26 () {56 vars in 1108 bytes} [Wed Aug 17 19:06:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 19:06:23.563259 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-356f8e5e-9e2a-40c9-8115-580990ed5abb None admin] Authenticating user token {{(pid=88551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:06:23.622325 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaf5d4a8-89ac-4437-b34d-9468380088e3 None admin] Validating token access rules against request {{(pid=88550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:06:23.665818 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b83a78c-feb4-4bde-ba22-010bcd6ac4ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '819d41a279e64291acc60de51e1530ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:06:23.666605 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b83a78c-feb4-4bde-ba22-010bcd6ac4ab None admin] REQUEST_METHOD: `GET` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:06:23.666888 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b83a78c-feb4-4bde-ba22-010bcd6ac4ab None admin] SCRIPT_NAME: `/identity` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:06:23.667156 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b83a78c-feb4-4bde-ba22-010bcd6ac4ab None admin] PATH_INFO: `/v3/users/nova` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:06:23.675412 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-356f8e5e-9e2a-40c9-8115-580990ed5abb None admin] Validating token access rules against request {{(pid=88551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:06:23.678343 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b83a78c-feb4-4bde-ba22-010bcd6ac4ab None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:06:23.680759 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b83a78c-feb4-4bde-ba22-010bcd6ac4ab None admin] RBAC: Authorization granted {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:06:23.694761 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application [None req-5b83a78c-feb4-4bde-ba22-010bcd6ac4ab None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 17 19:06:23.694761 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 19:06:23.694761 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 19:06:23.694761 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 19:06:23.694761 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 19:06:23.694761 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 19:06:23.694761 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 19:06:23.694761 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 19:06:23.694761 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 19:06:23.694761 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 19:06:23.694761 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 19:06:23.694761 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 19:06:23.694761 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 17 19:06:23.694761 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 17 19:06:23.694761 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 17 19:06:23.694761 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 17 19:06:23.696117 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 19:06:23.696117 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 19:06:23.696117 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 17 19:06:23.696117 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 17 19:06:23.696117 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 17 19:06:23.696117 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 17 19:06:23.696117 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 19:06:23.696117 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 19:06:23.696117 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 19:06:23.696117 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 19:06:23.696117 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 19:06:23.696117 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application with Lock( Aug 17 19:06:23.696117 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 19:06:23.696117 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return self._enter() Aug 17 19:06:23.696117 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 19:06:23.696117 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 19:06:23.696117 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 19:06:23.696117 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return self.creator() Aug 17 19:06:23.697180 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 19:06:23.697180 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application created_value = creator( Aug 17 19:06:23.697180 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 17 19:06:23.697180 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 17 19:06:23.697180 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 17 19:06:23.697180 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 17 19:06:23.697180 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 17 19:06:23.697180 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 17 19:06:23.697180 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 17 19:06:23.697180 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application Aug 17 19:06:23.698690 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: [pid: 88550|app: 0|req: 258/496] 10.222.0.26 () {56 vars in 1093 bytes} [Wed Aug 17 19:06:23 2022] GET /identity/v3/users/nova => generated 82 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 19:06:23.699770 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b83a78c-feb4-4bde-ba22-010bcd6ac4ab None admin] Authenticating user token {{(pid=88550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:06:23.711801 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0f03f7e-fc5a-4fcb-9441-0c7ea010c0d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '819d41a279e64291acc60de51e1530ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:06:23.712406 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f03f7e-fc5a-4fcb-9441-0c7ea010c0d5 None admin] REQUEST_METHOD: `GET` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:06:23.712714 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f03f7e-fc5a-4fcb-9441-0c7ea010c0d5 None admin] SCRIPT_NAME: `/identity` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:06:23.712993 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f03f7e-fc5a-4fcb-9441-0c7ea010c0d5 None admin] PATH_INFO: `/v3/roles` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:06:23.713687 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0f03f7e-fc5a-4fcb-9441-0c7ea010c0d5 None admin] RBAC: Adding query filter params (name=service) {{(pid=88551) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 19:06:23.713998 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0f03f7e-fc5a-4fcb-9441-0c7ea010c0d5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:06:23.715417 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0f03f7e-fc5a-4fcb-9441-0c7ea010c0d5 None admin] RBAC: Authorization granted {{(pid=88551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:06:23.724182 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: [pid: 88551|app: 0|req: 239/497] 10.222.0.26 () {56 vars in 1103 bytes} [Wed Aug 17 19:06:23 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 19:06:23.725017 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0f03f7e-fc5a-4fcb-9441-0c7ea010c0d5 None admin] Authenticating user token {{(pid=88551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:06:23.776070 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG dbcounter [-] [88551] Writing DB stats keystone:SELECT=100 {{(pid=88551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:06:23.803408 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG dbcounter [-] [88550] Writing DB stats keystone:SELECT=100 {{(pid=88550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:06:23.809251 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b83a78c-feb4-4bde-ba22-010bcd6ac4ab None admin] Validating token access rules against request {{(pid=88550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:06:23.828679 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0f03f7e-fc5a-4fcb-9441-0c7ea010c0d5 None admin] Validating token access rules against request {{(pid=88551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:06:23.845759 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35bd9e95-8dd9-4988-9915-0ba2efb2438f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '819d41a279e64291acc60de51e1530ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:06:23.846419 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35bd9e95-8dd9-4988-9915-0ba2efb2438f None admin] REQUEST_METHOD: `GET` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:06:23.850775 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35bd9e95-8dd9-4988-9915-0ba2efb2438f None admin] SCRIPT_NAME: `/identity` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:06:23.850775 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35bd9e95-8dd9-4988-9915-0ba2efb2438f None admin] PATH_INFO: `/v3/users/glance` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:06:23.855550 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35bd9e95-8dd9-4988-9915-0ba2efb2438f None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:06:23.857002 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35bd9e95-8dd9-4988-9915-0ba2efb2438f None admin] RBAC: Authorization granted {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:06:23.864936 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46ad1bf3-2d71-4411-8468-8e0e4fb1b319 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '819d41a279e64291acc60de51e1530ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:06:23.865544 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ad1bf3-2d71-4411-8468-8e0e4fb1b319 None admin] REQUEST_METHOD: `GET` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:06:23.865822 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ad1bf3-2d71-4411-8468-8e0e4fb1b319 None admin] SCRIPT_NAME: `/identity` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:06:23.866094 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ad1bf3-2d71-4411-8468-8e0e4fb1b319 None admin] PATH_INFO: `/v3/domains` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:06:23.866775 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46ad1bf3-2d71-4411-8468-8e0e4fb1b319 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88551) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 19:06:23.867080 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46ad1bf3-2d71-4411-8468-8e0e4fb1b319 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:06:23.868494 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46ad1bf3-2d71-4411-8468-8e0e4fb1b319 None admin] RBAC: Authorization granted {{(pid=88551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:06:23.868992 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application [None req-35bd9e95-8dd9-4988-9915-0ba2efb2438f None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Aug 17 19:06:23.868992 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 19:06:23.868992 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 19:06:23.868992 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 19:06:23.868992 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 19:06:23.868992 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 19:06:23.868992 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 19:06:23.868992 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 19:06:23.868992 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 19:06:23.868992 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 19:06:23.868992 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 19:06:23.868992 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 19:06:23.868992 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 17 19:06:23.868992 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 17 19:06:23.868992 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 17 19:06:23.868992 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 17 19:06:23.869903 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 19:06:23.869903 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 19:06:23.869903 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 17 19:06:23.869903 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 17 19:06:23.869903 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 17 19:06:23.869903 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 17 19:06:23.869903 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 19:06:23.869903 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 19:06:23.869903 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 19:06:23.869903 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 19:06:23.869903 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 19:06:23.869903 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application with Lock( Aug 17 19:06:23.869903 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 19:06:23.869903 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return self._enter() Aug 17 19:06:23.869903 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 19:06:23.869903 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 19:06:23.869903 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 19:06:23.869903 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return self.creator() Aug 17 19:06:23.870894 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 19:06:23.870894 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application created_value = creator( Aug 17 19:06:23.870894 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 17 19:06:23.870894 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 17 19:06:23.870894 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 17 19:06:23.870894 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 17 19:06:23.870894 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 17 19:06:23.870894 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 17 19:06:23.870894 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Aug 17 19:06:23.870894 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application Aug 17 19:06:23.870894 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: [pid: 88550|app: 0|req: 259/498] 10.222.0.26 () {56 vars in 1099 bytes} [Wed Aug 17 19:06:23 2022] GET /identity/v3/users/glance => generated 84 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 19:06:23.871474 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35bd9e95-8dd9-4988-9915-0ba2efb2438f None admin] Authenticating user token {{(pid=88550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:06:23.887895 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: [pid: 88551|app: 0|req: 240/499] 10.222.0.26 () {56 vars in 1109 bytes} [Wed Aug 17 19:06:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 19:06:23.888742 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46ad1bf3-2d71-4411-8468-8e0e4fb1b319 None admin] Authenticating user token {{(pid=88551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:06:23.989928 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35bd9e95-8dd9-4988-9915-0ba2efb2438f None admin] Validating token access rules against request {{(pid=88550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:06:24.000685 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46ad1bf3-2d71-4411-8468-8e0e4fb1b319 None admin] Validating token access rules against request {{(pid=88551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:06:24.011714 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG dbcounter [-] [88551] Writing DB stats keystone:SELECT=100 {{(pid=88551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:06:24.024723 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9388793b-ddf9-490e-bbf5-13c17117ca06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '819d41a279e64291acc60de51e1530ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:06:24.025330 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9388793b-ddf9-490e-bbf5-13c17117ca06 None admin] REQUEST_METHOD: `GET` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:06:24.025611 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9388793b-ddf9-490e-bbf5-13c17117ca06 None admin] SCRIPT_NAME: `/identity` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:06:24.025886 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9388793b-ddf9-490e-bbf5-13c17117ca06 None admin] PATH_INFO: `/v3/users` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:06:24.026647 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9388793b-ddf9-490e-bbf5-13c17117ca06 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=88550) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 19:06:24.026959 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9388793b-ddf9-490e-bbf5-13c17117ca06 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:06:24.028420 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9388793b-ddf9-490e-bbf5-13c17117ca06 None admin] RBAC: Authorization granted {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:06:24.034672 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6f6a168-e121-4e4b-94dc-e45f660809d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '819d41a279e64291acc60de51e1530ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:06:24.035295 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f6a168-e121-4e4b-94dc-e45f660809d0 None admin] REQUEST_METHOD: `GET` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:06:24.035595 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f6a168-e121-4e4b-94dc-e45f660809d0 None admin] SCRIPT_NAME: `/identity` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:06:24.035934 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f6a168-e121-4e4b-94dc-e45f660809d0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:06:24.047327 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6f6a168-e121-4e4b-94dc-e45f660809d0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:06:24.048806 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6f6a168-e121-4e4b-94dc-e45f660809d0 None admin] RBAC: Authorization granted {{(pid=88551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:06:24.068501 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: [pid: 88550|app: 0|req: 260/500] 10.222.0.26 () {56 vars in 1133 bytes} [Wed Aug 17 19:06:23 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 19:06:24.068673 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application [None req-b6f6a168-e121-4e4b-94dc-e45f660809d0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 19:06:24.068673 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 19:06:24.068673 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 19:06:24.068673 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 19:06:24.068673 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 19:06:24.068673 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 19:06:24.068673 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 19:06:24.068673 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 19:06:24.068673 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 19:06:24.068673 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 19:06:24.068673 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 19:06:24.068673 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 19:06:24.068673 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 17 19:06:24.068673 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 17 19:06:24.068673 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 17 19:06:24.068673 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 17 19:06:24.069655 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 19:06:24.069655 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 19:06:24.069655 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 19:06:24.069655 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 19:06:24.069655 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 19:06:24.069655 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 19:06:24.069655 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 19:06:24.069655 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application with Lock( Aug 17 19:06:24.069655 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 19:06:24.069655 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application return self._enter() Aug 17 19:06:24.069655 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 19:06:24.069655 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 19:06:24.069655 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 19:06:24.069655 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application return self.creator() Aug 17 19:06:24.069655 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 19:06:24.069655 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application created_value = creator( Aug 17 19:06:24.069655 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 17 19:06:24.070579 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 17 19:06:24.070579 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 19:06:24.070579 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application Aug 17 19:06:24.070753 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9388793b-ddf9-490e-bbf5-13c17117ca06 None admin] Authenticating user token {{(pid=88550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:06:24.070821 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: [pid: 88551|app: 0|req: 241/501] 10.222.0.26 () {56 vars in 1108 bytes} [Wed Aug 17 19:06:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 19:06:24.070821 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6f6a168-e121-4e4b-94dc-e45f660809d0 None admin] Authenticating user token {{(pid=88551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:06:24.088546 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG dbcounter [-] [88550] Writing DB stats keystone:SELECT=100 {{(pid=88550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:06:24.174440 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9388793b-ddf9-490e-bbf5-13c17117ca06 None admin] Validating token access rules against request {{(pid=88550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:06:24.177761 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6f6a168-e121-4e4b-94dc-e45f660809d0 None admin] Validating token access rules against request {{(pid=88551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:06:24.212397 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c713998c-6d25-4ffc-92d6-5a2043eb1b4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '819d41a279e64291acc60de51e1530ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:06:24.212804 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9be82cca-8f6a-4074-b9ec-adedcbf4bef3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '819d41a279e64291acc60de51e1530ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:06:24.213157 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c713998c-6d25-4ffc-92d6-5a2043eb1b4c None admin] REQUEST_METHOD: `GET` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:06:24.213431 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be82cca-8f6a-4074-b9ec-adedcbf4bef3 None admin] REQUEST_METHOD: `GET` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:06:24.213518 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c713998c-6d25-4ffc-92d6-5a2043eb1b4c None admin] SCRIPT_NAME: `/identity` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:06:24.213746 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be82cca-8f6a-4074-b9ec-adedcbf4bef3 None admin] SCRIPT_NAME: `/identity` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:06:24.213952 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c713998c-6d25-4ffc-92d6-5a2043eb1b4c None admin] PATH_INFO: `/v3/users` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:06:24.214107 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be82cca-8f6a-4074-b9ec-adedcbf4bef3 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:06:24.214980 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c713998c-6d25-4ffc-92d6-5a2043eb1b4c None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=88550) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 19:06:24.215379 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c713998c-6d25-4ffc-92d6-5a2043eb1b4c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:06:24.217718 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c713998c-6d25-4ffc-92d6-5a2043eb1b4c None admin] RBAC: Authorization granted {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:06:24.222906 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9be82cca-8f6a-4074-b9ec-adedcbf4bef3 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=88551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:06:24.224446 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9be82cca-8f6a-4074-b9ec-adedcbf4bef3 None admin] RBAC: Authorization granted {{(pid=88551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:06:24.236403 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: [pid: 88550|app: 0|req: 261/502] 10.222.0.26 () {56 vars in 1137 bytes} [Wed Aug 17 19:06:24 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 19:06:24.237251 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c713998c-6d25-4ffc-92d6-5a2043eb1b4c None admin] Authenticating user token {{(pid=88550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:06:24.237743 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application [None req-9be82cca-8f6a-4074-b9ec-adedcbf4bef3 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Aug 17 19:06:24.237743 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 19:06:24.237743 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 19:06:24.237743 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 19:06:24.237743 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 19:06:24.237743 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 19:06:24.237743 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 19:06:24.237743 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 19:06:24.237743 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 19:06:24.237743 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 19:06:24.237743 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 19:06:24.237743 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 19:06:24.237743 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 17 19:06:24.237743 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 17 19:06:24.237743 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 17 19:06:24.237743 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 17 19:06:24.238695 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 19:06:24.238695 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 19:06:24.238695 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 17 19:06:24.238695 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 17 19:06:24.238695 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 17 19:06:24.238695 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 17 19:06:24.238695 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 19:06:24.238695 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 19:06:24.238695 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 19:06:24.238695 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 19:06:24.238695 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 19:06:24.238695 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application with Lock( Aug 17 19:06:24.238695 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 19:06:24.238695 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application return self._enter() Aug 17 19:06:24.238695 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 19:06:24.238695 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 19:06:24.238695 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 19:06:24.238695 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application return self.creator() Aug 17 19:06:24.239602 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 19:06:24.239602 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application created_value = creator( Aug 17 19:06:24.239602 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 17 19:06:24.239602 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 17 19:06:24.239602 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 17 19:06:24.239602 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 17 19:06:24.239602 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 17 19:06:24.239602 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 17 19:06:24.239602 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Aug 17 19:06:24.239602 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application Aug 17 19:06:24.239602 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: [pid: 88551|app: 0|req: 242/503] 10.222.0.26 () {56 vars in 1099 bytes} [Wed Aug 17 19:06:24 2022] GET /identity/v3/users/cinder => generated 84 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 19:06:24.240158 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9be82cca-8f6a-4074-b9ec-adedcbf4bef3 None admin] Authenticating user token {{(pid=88551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:06:24.267113 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG dbcounter [-] [88551] Writing DB stats keystone:SELECT=100 {{(pid=88551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:06:24.323823 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG dbcounter [-] [88550] Writing DB stats keystone:SELECT=100 {{(pid=88550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:06:24.349328 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9be82cca-8f6a-4074-b9ec-adedcbf4bef3 None admin] Validating token access rules against request {{(pid=88551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:06:24.357116 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c713998c-6d25-4ffc-92d6-5a2043eb1b4c None admin] Validating token access rules against request {{(pid=88550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:06:24.385292 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aee05bbc-51da-4bc8-8a5f-59c92f1500a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '819d41a279e64291acc60de51e1530ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:06:24.385896 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee05bbc-51da-4bc8-8a5f-59c92f1500a3 None admin] REQUEST_METHOD: `GET` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:06:24.386175 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee05bbc-51da-4bc8-8a5f-59c92f1500a3 None admin] SCRIPT_NAME: `/identity` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:06:24.386454 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee05bbc-51da-4bc8-8a5f-59c92f1500a3 None admin] PATH_INFO: `/v3/domains` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:06:24.387126 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aee05bbc-51da-4bc8-8a5f-59c92f1500a3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88551) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 19:06:24.388298 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aee05bbc-51da-4bc8-8a5f-59c92f1500a3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:06:24.390314 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aee05bbc-51da-4bc8-8a5f-59c92f1500a3 None admin] RBAC: Authorization granted {{(pid=88551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:06:24.392169 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df1c1954-7260-49a9-bf74-dd7bfa61ebca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '819d41a279e64291acc60de51e1530ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:06:24.392769 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df1c1954-7260-49a9-bf74-dd7bfa61ebca None admin] REQUEST_METHOD: `GET` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:06:24.393043 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df1c1954-7260-49a9-bf74-dd7bfa61ebca None admin] SCRIPT_NAME: `/identity` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:06:24.393311 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df1c1954-7260-49a9-bf74-dd7bfa61ebca None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:06:24.403781 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: [pid: 88551|app: 0|req: 243/504] 10.222.0.26 () {56 vars in 1109 bytes} [Wed Aug 17 19:06:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 19:06:24.404691 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aee05bbc-51da-4bc8-8a5f-59c92f1500a3 None admin] Authenticating user token {{(pid=88551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:06:24.468885 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df1c1954-7260-49a9-bf74-dd7bfa61ebca None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:06:24.470583 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df1c1954-7260-49a9-bf74-dd7bfa61ebca None admin] RBAC: Authorization granted {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:06:24.489953 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG dbcounter [-] [88551] Writing DB stats keystone:SELECT=100 {{(pid=88551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:06:24.508871 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aee05bbc-51da-4bc8-8a5f-59c92f1500a3 None admin] Validating token access rules against request {{(pid=88551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:06:24.539465 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG dbcounter [-] [88550] Writing DB stats keystone:SELECT=100 {{(pid=88550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:06:24.546773 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2adccfe5-18cb-4495-afa9-721140a7559d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '819d41a279e64291acc60de51e1530ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:06:24.547373 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2adccfe5-18cb-4495-afa9-721140a7559d None admin] REQUEST_METHOD: `GET` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:06:24.547653 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2adccfe5-18cb-4495-afa9-721140a7559d None admin] SCRIPT_NAME: `/identity` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:06:24.547929 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2adccfe5-18cb-4495-afa9-721140a7559d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:06:24.572313 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: [pid: 88550|app: 0|req: 262/505] 10.222.0.26 () {58 vars in 1282 bytes} [Wed Aug 17 19:06:24 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 335 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 17 19:06:24.573162 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df1c1954-7260-49a9-bf74-dd7bfa61ebca None admin] Authenticating user token {{(pid=88550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:06:24.622248 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2adccfe5-18cb-4495-afa9-721140a7559d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:06:24.624204 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2adccfe5-18cb-4495-afa9-721140a7559d None admin] RBAC: Authorization granted {{(pid=88551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:06:24.681105 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df1c1954-7260-49a9-bf74-dd7bfa61ebca None admin] Validating token access rules against request {{(pid=88550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:06:24.707306 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG dbcounter [-] [88551] Writing DB stats keystone:SELECT=100 {{(pid=88551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:06:24.715861 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31573359-ff38-42df-adc2-8c33a3204946 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '819d41a279e64291acc60de51e1530ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:06:24.716473 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31573359-ff38-42df-adc2-8c33a3204946 None admin] REQUEST_METHOD: `GET` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:06:24.716754 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31573359-ff38-42df-adc2-8c33a3204946 None admin] SCRIPT_NAME: `/identity` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:06:24.717057 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31573359-ff38-42df-adc2-8c33a3204946 None admin] PATH_INFO: `/v3/users` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:06:24.717890 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31573359-ff38-42df-adc2-8c33a3204946 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=88550) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 19:06:24.718089 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31573359-ff38-42df-adc2-8c33a3204946 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:06:24.719605 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31573359-ff38-42df-adc2-8c33a3204946 None admin] RBAC: Authorization granted {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:06:24.726398 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: [pid: 88551|app: 0|req: 244/506] 10.222.0.26 () {58 vars in 1282 bytes} [Wed Aug 17 19:06:24 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 322 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 17 19:06:24.727482 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2adccfe5-18cb-4495-afa9-721140a7559d None admin] Authenticating user token {{(pid=88551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:06:24.741184 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: [pid: 88550|app: 0|req: 263/507] 10.222.0.26 () {56 vars in 1137 bytes} [Wed Aug 17 19:06:24 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 19:06:24.742036 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31573359-ff38-42df-adc2-8c33a3204946 None admin] Authenticating user token {{(pid=88550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:06:24.771692 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG dbcounter [-] [88550] Writing DB stats keystone:SELECT=100 {{(pid=88550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:06:24.834019 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2adccfe5-18cb-4495-afa9-721140a7559d None admin] Validating token access rules against request {{(pid=88551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:06:24.843972 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31573359-ff38-42df-adc2-8c33a3204946 None admin] Validating token access rules against request {{(pid=88550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:06:24.867863 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-145613a6-7453-4d54-bd36-d15ab2d4f398 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '819d41a279e64291acc60de51e1530ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:06:24.868475 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-145613a6-7453-4d54-bd36-d15ab2d4f398 None admin] REQUEST_METHOD: `GET` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:06:24.868755 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-145613a6-7453-4d54-bd36-d15ab2d4f398 None admin] SCRIPT_NAME: `/identity` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:06:24.869027 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-145613a6-7453-4d54-bd36-d15ab2d4f398 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:06:24.877332 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-145613a6-7453-4d54-bd36-d15ab2d4f398 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=88551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:06:24.877809 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a89268f-19d8-4d27-a951-62207549e9bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '819d41a279e64291acc60de51e1530ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:06:24.878432 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a89268f-19d8-4d27-a951-62207549e9bb None admin] REQUEST_METHOD: `GET` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:06:24.878727 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-145613a6-7453-4d54-bd36-d15ab2d4f398 None admin] RBAC: Authorization granted {{(pid=88551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:06:24.878842 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a89268f-19d8-4d27-a951-62207549e9bb None admin] SCRIPT_NAME: `/identity` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:06:24.879001 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a89268f-19d8-4d27-a951-62207549e9bb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:06:24.889168 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a89268f-19d8-4d27-a951-62207549e9bb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:06:24.890267 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application [None req-145613a6-7453-4d54-bd36-d15ab2d4f398 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Aug 17 19:06:24.890267 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 19:06:24.890267 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 19:06:24.890267 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 19:06:24.890267 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 19:06:24.890267 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 19:06:24.890267 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 19:06:24.890267 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 19:06:24.890267 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 19:06:24.890267 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 19:06:24.890267 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 19:06:24.890267 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 19:06:24.890267 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 17 19:06:24.890267 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 17 19:06:24.890267 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 17 19:06:24.890267 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 17 19:06:24.891245 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 19:06:24.891245 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 19:06:24.891245 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 17 19:06:24.891245 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 17 19:06:24.891245 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 17 19:06:24.891245 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 17 19:06:24.891245 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 19:06:24.891245 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 19:06:24.891245 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 19:06:24.891245 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 19:06:24.891245 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 19:06:24.891245 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application with Lock( Aug 17 19:06:24.891245 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 19:06:24.891245 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application return self._enter() Aug 17 19:06:24.891245 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 19:06:24.891245 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 19:06:24.891245 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 19:06:24.891245 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application return self.creator() Aug 17 19:06:24.892139 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 19:06:24.892139 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application created_value = creator( Aug 17 19:06:24.892139 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 17 19:06:24.892139 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 17 19:06:24.892139 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 17 19:06:24.892139 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 17 19:06:24.892139 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 17 19:06:24.892139 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 17 19:06:24.892139 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Aug 17 19:06:24.892139 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application Aug 17 19:06:24.892639 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a89268f-19d8-4d27-a951-62207549e9bb None admin] RBAC: Authorization granted {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:06:24.892707 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: [pid: 88551|app: 0|req: 245/508] 10.222.0.26 () {56 vars in 1102 bytes} [Wed Aug 17 19:06:24 2022] GET /identity/v3/users/neutron => generated 85 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 19:06:24.892707 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-145613a6-7453-4d54-bd36-d15ab2d4f398 None admin] Authenticating user token {{(pid=88551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:06:24.909284 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application [None req-6a89268f-19d8-4d27-a951-62207549e9bb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 19:06:24.909284 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 19:06:24.909284 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 19:06:24.909284 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 19:06:24.909284 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 19:06:24.909284 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 19:06:24.909284 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 19:06:24.909284 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 19:06:24.909284 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 19:06:24.909284 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 19:06:24.909284 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 19:06:24.909284 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 19:06:24.909284 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 17 19:06:24.909284 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 17 19:06:24.909284 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 17 19:06:24.909284 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 17 19:06:24.910467 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 19:06:24.910467 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 19:06:24.910467 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 19:06:24.910467 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 19:06:24.910467 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 19:06:24.910467 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 19:06:24.910467 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 19:06:24.910467 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application with Lock( Aug 17 19:06:24.910467 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 19:06:24.910467 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return self._enter() Aug 17 19:06:24.910467 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 19:06:24.910467 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 19:06:24.910467 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 19:06:24.910467 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return self.creator() Aug 17 19:06:24.910467 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 19:06:24.910467 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application created_value = creator( Aug 17 19:06:24.910467 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 17 19:06:24.911370 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 17 19:06:24.911370 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 19:06:24.911370 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application Aug 17 19:06:24.911370 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: [pid: 88550|app: 0|req: 264/509] 10.222.0.26 () {56 vars in 1108 bytes} [Wed Aug 17 19:06:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 19:06:24.911370 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a89268f-19d8-4d27-a951-62207549e9bb None admin] Authenticating user token {{(pid=88550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:06:24.945641 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG dbcounter [-] [88551] Writing DB stats keystone:SELECT=100 {{(pid=88551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:06:24.999338 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG dbcounter [-] [88550] Writing DB stats keystone:SELECT=100 {{(pid=88550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:06:25.004855 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-145613a6-7453-4d54-bd36-d15ab2d4f398 None admin] Validating token access rules against request {{(pid=88551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:06:25.018342 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a89268f-19d8-4d27-a951-62207549e9bb None admin] Validating token access rules against request {{(pid=88550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:06:25.048114 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c00c6e96-f914-46d4-8013-39052bcd20cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '819d41a279e64291acc60de51e1530ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:06:25.048734 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c00c6e96-f914-46d4-8013-39052bcd20cf None admin] REQUEST_METHOD: `GET` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:06:25.049083 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c00c6e96-f914-46d4-8013-39052bcd20cf None admin] SCRIPT_NAME: `/identity` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:06:25.049256 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c00c6e96-f914-46d4-8013-39052bcd20cf None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:06:25.053861 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-466e606d-0bf1-4600-b21c-e12b46a5bfb7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '819d41a279e64291acc60de51e1530ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:06:25.054470 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-466e606d-0bf1-4600-b21c-e12b46a5bfb7 None admin] REQUEST_METHOD: `GET` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:06:25.054784 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-466e606d-0bf1-4600-b21c-e12b46a5bfb7 None admin] SCRIPT_NAME: `/identity` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:06:25.055057 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-466e606d-0bf1-4600-b21c-e12b46a5bfb7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:06:25.060052 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c00c6e96-f914-46d4-8013-39052bcd20cf None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:06:25.061824 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c00c6e96-f914-46d4-8013-39052bcd20cf None admin] RBAC: Authorization granted {{(pid=88551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:06:25.076793 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application [None req-c00c6e96-f914-46d4-8013-39052bcd20cf None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 19:06:25.076793 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 19:06:25.076793 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 19:06:25.076793 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 19:06:25.076793 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 19:06:25.076793 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 19:06:25.076793 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 19:06:25.076793 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 19:06:25.076793 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 19:06:25.076793 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 19:06:25.076793 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 19:06:25.076793 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 19:06:25.076793 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 17 19:06:25.076793 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 17 19:06:25.076793 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 17 19:06:25.076793 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 17 19:06:25.081444 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 19:06:25.081444 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 19:06:25.081444 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 19:06:25.081444 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 19:06:25.081444 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 19:06:25.081444 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 19:06:25.081444 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 19:06:25.081444 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application with Lock( Aug 17 19:06:25.081444 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 19:06:25.081444 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application return self._enter() Aug 17 19:06:25.081444 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 19:06:25.081444 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 19:06:25.081444 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 19:06:25.081444 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application return self.creator() Aug 17 19:06:25.081444 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 19:06:25.081444 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application created_value = creator( Aug 17 19:06:25.081444 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 17 19:06:25.083203 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 17 19:06:25.083203 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 19:06:25.083203 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application Aug 17 19:06:25.083203 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: [pid: 88551|app: 0|req: 246/510] 10.222.0.26 () {56 vars in 1108 bytes} [Wed Aug 17 19:06:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 19:06:25.083203 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c00c6e96-f914-46d4-8013-39052bcd20cf None admin] Authenticating user token {{(pid=88551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:06:25.137091 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-466e606d-0bf1-4600-b21c-e12b46a5bfb7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:06:25.138679 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-466e606d-0bf1-4600-b21c-e12b46a5bfb7 None admin] RBAC: Authorization granted {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:06:25.182272 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG dbcounter [-] [88551] Writing DB stats keystone:SELECT=100 {{(pid=88551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:06:25.189175 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c00c6e96-f914-46d4-8013-39052bcd20cf None admin] Validating token access rules against request {{(pid=88551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:06:25.224568 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG dbcounter [-] [88550] Writing DB stats keystone:SELECT=100 {{(pid=88550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:06:25.227168 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cff07a15-1049-49d9-b628-dbf2c57a19bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '819d41a279e64291acc60de51e1530ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:06:25.227815 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff07a15-1049-49d9-b628-dbf2c57a19bf None admin] REQUEST_METHOD: `GET` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:06:25.228097 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff07a15-1049-49d9-b628-dbf2c57a19bf None admin] SCRIPT_NAME: `/identity` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:06:25.228368 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff07a15-1049-49d9-b628-dbf2c57a19bf None admin] PATH_INFO: `/v3/users` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:06:25.229084 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cff07a15-1049-49d9-b628-dbf2c57a19bf None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=88551) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 19:06:25.229380 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cff07a15-1049-49d9-b628-dbf2c57a19bf None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:06:25.230824 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cff07a15-1049-49d9-b628-dbf2c57a19bf None admin] RBAC: Authorization granted {{(pid=88551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:06:25.243849 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: [pid: 88550|app: 0|req: 265/511] 10.222.0.26 () {58 vars in 1282 bytes} [Wed Aug 17 19:06:24 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 333 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 17 19:06:25.244697 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-466e606d-0bf1-4600-b21c-e12b46a5bfb7 None admin] Authenticating user token {{(pid=88550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:06:25.269973 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: [pid: 88551|app: 0|req: 247/512] 10.222.0.26 () {56 vars in 1139 bytes} [Wed Aug 17 19:06:25 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 19:06:25.270831 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cff07a15-1049-49d9-b628-dbf2c57a19bf None admin] Authenticating user token {{(pid=88551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:06:25.350219 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-466e606d-0bf1-4600-b21c-e12b46a5bfb7 None admin] Validating token access rules against request {{(pid=88550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:06:25.385769 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3910890d-e466-4908-ae46-9d7cc8021b00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '819d41a279e64291acc60de51e1530ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:06:25.386373 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3910890d-e466-4908-ae46-9d7cc8021b00 None admin] REQUEST_METHOD: `GET` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:06:25.386510 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cff07a15-1049-49d9-b628-dbf2c57a19bf None admin] Validating token access rules against request {{(pid=88551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:06:25.386706 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3910890d-e466-4908-ae46-9d7cc8021b00 None admin] SCRIPT_NAME: `/identity` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:06:25.386979 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3910890d-e466-4908-ae46-9d7cc8021b00 None admin] PATH_INFO: `/v3/domains` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:06:25.387667 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3910890d-e466-4908-ae46-9d7cc8021b00 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88550) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 19:06:25.387975 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3910890d-e466-4908-ae46-9d7cc8021b00 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:06:25.389928 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3910890d-e466-4908-ae46-9d7cc8021b00 None admin] RBAC: Authorization granted {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:06:25.401432 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: [pid: 88550|app: 0|req: 266/513] 10.222.0.26 () {56 vars in 1109 bytes} [Wed Aug 17 19:06:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 19:06:25.402269 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3910890d-e466-4908-ae46-9d7cc8021b00 None admin] Authenticating user token {{(pid=88550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:06:25.423327 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ec7c94b-8f76-4058-a049-59435c8252af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '819d41a279e64291acc60de51e1530ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:06:25.423927 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec7c94b-8f76-4058-a049-59435c8252af None admin] REQUEST_METHOD: `GET` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:06:25.424227 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec7c94b-8f76-4058-a049-59435c8252af None admin] SCRIPT_NAME: `/identity` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:06:25.424541 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec7c94b-8f76-4058-a049-59435c8252af None admin] PATH_INFO: `/v3/domains` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:06:25.425195 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ec7c94b-8f76-4058-a049-59435c8252af None admin] RBAC: Adding query filter params (name=Default) {{(pid=88551) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 19:06:25.425494 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ec7c94b-8f76-4058-a049-59435c8252af None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:06:25.426916 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ec7c94b-8f76-4058-a049-59435c8252af None admin] RBAC: Authorization granted {{(pid=88551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:06:25.439332 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: [pid: 88551|app: 0|req: 248/514] 10.222.0.26 () {56 vars in 1109 bytes} [Wed Aug 17 19:06:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 19:06:25.439954 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ec7c94b-8f76-4058-a049-59435c8252af None admin] Authenticating user token {{(pid=88551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:06:25.455397 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG dbcounter [-] [88551] Writing DB stats keystone:SELECT=100 {{(pid=88551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:06:25.458353 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG dbcounter [-] [88550] Writing DB stats keystone:SELECT=100 {{(pid=88550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:06:25.516549 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3910890d-e466-4908-ae46-9d7cc8021b00 None admin] Validating token access rules against request {{(pid=88550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:06:25.545548 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ec7c94b-8f76-4058-a049-59435c8252af None admin] Validating token access rules against request {{(pid=88551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:06:25.554147 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc72ee15-c68e-486e-ad61-a48746fab1c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '819d41a279e64291acc60de51e1530ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:06:25.554851 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc72ee15-c68e-486e-ad61-a48746fab1c9 None admin] REQUEST_METHOD: `GET` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:06:25.555133 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc72ee15-c68e-486e-ad61-a48746fab1c9 None admin] SCRIPT_NAME: `/identity` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:06:25.555457 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc72ee15-c68e-486e-ad61-a48746fab1c9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:06:25.567117 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc72ee15-c68e-486e-ad61-a48746fab1c9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:06:25.568560 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc72ee15-c68e-486e-ad61-a48746fab1c9 None admin] RBAC: Authorization granted {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:06:25.583476 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application [None req-bc72ee15-c68e-486e-ad61-a48746fab1c9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 19:06:25.583476 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 19:06:25.583476 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 19:06:25.583476 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 19:06:25.583476 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 19:06:25.583476 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 19:06:25.583476 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 19:06:25.583476 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 19:06:25.583476 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 19:06:25.583476 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 19:06:25.583476 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 19:06:25.583476 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 19:06:25.583476 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 17 19:06:25.583476 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 17 19:06:25.583476 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 17 19:06:25.583476 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 17 19:06:25.584463 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 19:06:25.584463 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 19:06:25.584463 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 19:06:25.584463 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 19:06:25.584463 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 19:06:25.584463 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 19:06:25.584463 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 19:06:25.584463 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application with Lock( Aug 17 19:06:25.584463 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 19:06:25.584463 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return self._enter() Aug 17 19:06:25.584463 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 19:06:25.584463 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 19:06:25.584463 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 19:06:25.584463 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return self.creator() Aug 17 19:06:25.584463 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 19:06:25.584463 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application created_value = creator( Aug 17 19:06:25.584463 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 17 19:06:25.585325 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 17 19:06:25.585325 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 19:06:25.585325 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application Aug 17 19:06:25.585489 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1fadd75-f1d6-4565-8439-ddc98a987042 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '819d41a279e64291acc60de51e1530ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:06:25.585587 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: [pid: 88550|app: 0|req: 267/515] 10.222.0.26 () {56 vars in 1108 bytes} [Wed Aug 17 19:06:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 19:06:25.585657 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1fadd75-f1d6-4565-8439-ddc98a987042 None admin] REQUEST_METHOD: `GET` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:06:25.585657 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1fadd75-f1d6-4565-8439-ddc98a987042 None admin] SCRIPT_NAME: `/identity` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:06:25.585657 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1fadd75-f1d6-4565-8439-ddc98a987042 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:06:25.585824 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc72ee15-c68e-486e-ad61-a48746fab1c9 None admin] Authenticating user token {{(pid=88550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:06:25.654465 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1fadd75-f1d6-4565-8439-ddc98a987042 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:06:25.656685 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1fadd75-f1d6-4565-8439-ddc98a987042 None admin] RBAC: Authorization granted {{(pid=88551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:06:25.671001 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG dbcounter [-] [88551] Writing DB stats keystone:SELECT=100 {{(pid=88551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:06:25.680728 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG dbcounter [-] [88550] Writing DB stats keystone:SELECT=100 {{(pid=88550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:06:25.688320 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc72ee15-c68e-486e-ad61-a48746fab1c9 None admin] Validating token access rules against request {{(pid=88550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:06:25.720773 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c4220d1-311c-4d17-97e2-fd419b51d901 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '819d41a279e64291acc60de51e1530ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:06:25.724598 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c4220d1-311c-4d17-97e2-fd419b51d901 None admin] REQUEST_METHOD: `GET` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:06:25.724598 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c4220d1-311c-4d17-97e2-fd419b51d901 None admin] SCRIPT_NAME: `/identity` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:06:25.724598 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c4220d1-311c-4d17-97e2-fd419b51d901 None admin] PATH_INFO: `/v3/projects/service` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:06:25.731007 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c4220d1-311c-4d17-97e2-fd419b51d901 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:06:25.733738 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c4220d1-311c-4d17-97e2-fd419b51d901 None admin] RBAC: Authorization granted {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:06:25.747597 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application [None req-2c4220d1-311c-4d17-97e2-fd419b51d901 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 17 19:06:25.747597 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 19:06:25.747597 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 19:06:25.747597 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 19:06:25.747597 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 19:06:25.747597 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 19:06:25.747597 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 19:06:25.747597 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 19:06:25.747597 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 19:06:25.747597 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 19:06:25.747597 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 19:06:25.747597 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 19:06:25.747597 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 17 19:06:25.747597 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 17 19:06:25.747597 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 17 19:06:25.749136 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 17 19:06:25.749136 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 19:06:25.749136 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 19:06:25.749136 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 19:06:25.749136 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 19:06:25.749136 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 19:06:25.749136 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 19:06:25.749136 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 19:06:25.749136 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application with Lock( Aug 17 19:06:25.749136 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 19:06:25.749136 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return self._enter() Aug 17 19:06:25.749136 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 19:06:25.749136 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 19:06:25.749136 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 19:06:25.749136 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return self.creator() Aug 17 19:06:25.749136 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 19:06:25.749136 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application created_value = creator( Aug 17 19:06:25.750054 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 17 19:06:25.750054 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 17 19:06:25.750054 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 17 19:06:25.750054 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 17 19:06:25.750054 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 17 19:06:25.750054 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 17 19:06:25.750054 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 17 19:06:25.750054 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application Aug 17 19:06:25.750054 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: [pid: 88550|app: 0|req: 268/516] 10.222.0.26 () {56 vars in 1111 bytes} [Wed Aug 17 19:06:25 2022] GET /identity/v3/projects/service => generated 88 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 19:06:25.750638 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c4220d1-311c-4d17-97e2-fd419b51d901 None admin] Authenticating user token {{(pid=88550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:06:25.768197 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: [pid: 88551|app: 0|req: 249/517] 10.222.0.26 () {58 vars in 1282 bytes} [Wed Aug 17 19:06:25 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 329 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 17 19:06:25.769077 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1fadd75-f1d6-4565-8439-ddc98a987042 None admin] Authenticating user token {{(pid=88551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:06:25.860801 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c4220d1-311c-4d17-97e2-fd419b51d901 None admin] Validating token access rules against request {{(pid=88550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:06:25.878911 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1fadd75-f1d6-4565-8439-ddc98a987042 None admin] Validating token access rules against request {{(pid=88551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:06:25.894298 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG dbcounter [-] [88551] Writing DB stats keystone:SELECT=100 {{(pid=88551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:06:25.896673 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d67d753c-1ce5-490d-8bc1-775a9329d8d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '819d41a279e64291acc60de51e1530ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:06:25.897302 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d67d753c-1ce5-490d-8bc1-775a9329d8d7 None admin] REQUEST_METHOD: `GET` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:06:25.897584 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d67d753c-1ce5-490d-8bc1-775a9329d8d7 None admin] SCRIPT_NAME: `/identity` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:06:25.897858 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d67d753c-1ce5-490d-8bc1-775a9329d8d7 None admin] PATH_INFO: `/v3/projects/service` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:06:25.910571 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d67d753c-1ce5-490d-8bc1-775a9329d8d7 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:06:25.910571 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d67d753c-1ce5-490d-8bc1-775a9329d8d7 None admin] RBAC: Authorization granted {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:06:25.915515 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4b02386-897c-4909-b060-5c201589f43e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '819d41a279e64291acc60de51e1530ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:06:25.916124 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b02386-897c-4909-b060-5c201589f43e None admin] REQUEST_METHOD: `GET` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:06:25.916405 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b02386-897c-4909-b060-5c201589f43e None admin] SCRIPT_NAME: `/identity` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:06:25.916680 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b02386-897c-4909-b060-5c201589f43e None admin] PATH_INFO: `/v3/domains` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:06:25.917331 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4b02386-897c-4909-b060-5c201589f43e None admin] RBAC: Adding query filter params (name=Default) {{(pid=88551) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 19:06:25.917632 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4b02386-897c-4909-b060-5c201589f43e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:06:25.918074 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application [None req-d67d753c-1ce5-490d-8bc1-775a9329d8d7 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 17 19:06:25.918074 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 19:06:25.918074 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 19:06:25.918074 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 19:06:25.918074 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 19:06:25.918074 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 19:06:25.918074 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 19:06:25.918074 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 19:06:25.918074 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 19:06:25.918074 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 19:06:25.918074 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 19:06:25.918074 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 19:06:25.918074 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 17 19:06:25.918074 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 17 19:06:25.918074 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 17 19:06:25.919576 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 17 19:06:25.919576 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 19:06:25.919576 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 19:06:25.919576 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 19:06:25.919576 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 19:06:25.919576 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 19:06:25.919576 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 19:06:25.919576 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 19:06:25.919576 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application with Lock( Aug 17 19:06:25.919576 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 19:06:25.919576 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return self._enter() Aug 17 19:06:25.919576 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 19:06:25.919576 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 19:06:25.919576 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 19:06:25.919576 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return self.creator() Aug 17 19:06:25.919576 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 19:06:25.919576 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application created_value = creator( Aug 17 19:06:25.921660 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 17 19:06:25.921660 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 17 19:06:25.921660 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 17 19:06:25.921660 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 17 19:06:25.921660 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 17 19:06:25.921660 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 17 19:06:25.921660 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 17 19:06:25.921660 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application Aug 17 19:06:25.922410 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4b02386-897c-4909-b060-5c201589f43e None admin] RBAC: Authorization granted {{(pid=88551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:06:25.922523 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: [pid: 88550|app: 0|req: 269/518] 10.222.0.26 () {56 vars in 1111 bytes} [Wed Aug 17 19:06:25 2022] GET /identity/v3/projects/service => generated 88 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 19:06:25.925339 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d67d753c-1ce5-490d-8bc1-775a9329d8d7 None admin] Authenticating user token {{(pid=88550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:06:25.936209 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: [pid: 88551|app: 0|req: 250/519] 10.222.0.26 () {56 vars in 1109 bytes} [Wed Aug 17 19:06:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 19:06:25.937084 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4b02386-897c-4909-b060-5c201589f43e None admin] Authenticating user token {{(pid=88551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:06:25.947085 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG dbcounter [-] [88550] Writing DB stats keystone:SELECT=100 {{(pid=88550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:06:26.034518 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d67d753c-1ce5-490d-8bc1-775a9329d8d7 None admin] Validating token access rules against request {{(pid=88550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:06:26.041466 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4b02386-897c-4909-b060-5c201589f43e None admin] Validating token access rules against request {{(pid=88551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:06:26.070323 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a10c1b56-98ff-4373-9274-a12272256419 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '819d41a279e64291acc60de51e1530ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:06:26.071200 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10c1b56-98ff-4373-9274-a12272256419 None admin] REQUEST_METHOD: `GET` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:06:26.071484 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10c1b56-98ff-4373-9274-a12272256419 None admin] SCRIPT_NAME: `/identity` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:06:26.071779 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10c1b56-98ff-4373-9274-a12272256419 None admin] PATH_INFO: `/v3/projects` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:06:26.072472 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a10c1b56-98ff-4373-9274-a12272256419 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88550) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 19:06:26.072780 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a10c1b56-98ff-4373-9274-a12272256419 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:06:26.074272 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a10c1b56-98ff-4373-9274-a12272256419 None admin] RBAC: Authorization granted {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:06:26.082183 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ae49a26-66bd-4233-8a48-0c5557553075 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '819d41a279e64291acc60de51e1530ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:06:26.082851 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae49a26-66bd-4233-8a48-0c5557553075 None admin] REQUEST_METHOD: `GET` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:06:26.083132 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae49a26-66bd-4233-8a48-0c5557553075 None admin] SCRIPT_NAME: `/identity` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:06:26.083405 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae49a26-66bd-4233-8a48-0c5557553075 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:06:26.094282 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: [pid: 88550|app: 0|req: 270/520] 10.222.0.26 () {56 vars in 1148 bytes} [Wed Aug 17 19:06:25 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 19:06:26.095216 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a10c1b56-98ff-4373-9274-a12272256419 None admin] Authenticating user token {{(pid=88550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:06:26.100055 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ae49a26-66bd-4233-8a48-0c5557553075 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:06:26.101530 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ae49a26-66bd-4233-8a48-0c5557553075 None admin] RBAC: Authorization granted {{(pid=88551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:06:26.117763 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application [None req-0ae49a26-66bd-4233-8a48-0c5557553075 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 19:06:26.117763 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 19:06:26.117763 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 19:06:26.117763 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 19:06:26.117763 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 19:06:26.117763 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 19:06:26.117763 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 19:06:26.117763 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 19:06:26.117763 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 19:06:26.117763 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 19:06:26.117763 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 19:06:26.117763 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 19:06:26.117763 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 17 19:06:26.117763 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 17 19:06:26.117763 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 17 19:06:26.117763 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 17 19:06:26.118822 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 19:06:26.118822 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 19:06:26.118822 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 19:06:26.118822 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 19:06:26.118822 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 19:06:26.118822 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 19:06:26.118822 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 19:06:26.118822 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application with Lock( Aug 17 19:06:26.118822 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 19:06:26.118822 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application return self._enter() Aug 17 19:06:26.118822 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 19:06:26.118822 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 19:06:26.118822 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 19:06:26.118822 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application return self.creator() Aug 17 19:06:26.118822 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 19:06:26.118822 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application created_value = creator( Aug 17 19:06:26.118822 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 17 19:06:26.119700 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 17 19:06:26.119700 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 19:06:26.119700 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application Aug 17 19:06:26.126604 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: [pid: 88551|app: 0|req: 251/521] 10.222.0.26 () {56 vars in 1108 bytes} [Wed Aug 17 19:06:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 19:06:26.127521 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ae49a26-66bd-4233-8a48-0c5557553075 None admin] Authenticating user token {{(pid=88551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:06:26.154092 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG dbcounter [-] [88551] Writing DB stats keystone:SELECT=100 {{(pid=88551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:06:26.184624 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG dbcounter [-] [88550] Writing DB stats keystone:SELECT=100 {{(pid=88550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:06:26.206744 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a10c1b56-98ff-4373-9274-a12272256419 None admin] Validating token access rules against request {{(pid=88550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:06:26.231988 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ae49a26-66bd-4233-8a48-0c5557553075 None admin] Validating token access rules against request {{(pid=88551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:06:26.243375 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f13500a-bce9-4356-937b-2db98ff8e91b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '819d41a279e64291acc60de51e1530ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:06:26.243973 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f13500a-bce9-4356-937b-2db98ff8e91b None admin] REQUEST_METHOD: `GET` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:06:26.244249 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f13500a-bce9-4356-937b-2db98ff8e91b None admin] SCRIPT_NAME: `/identity` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:06:26.244515 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f13500a-bce9-4356-937b-2db98ff8e91b None admin] PATH_INFO: `/v3/projects` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:06:26.245197 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f13500a-bce9-4356-937b-2db98ff8e91b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88550) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 19:06:26.245500 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f13500a-bce9-4356-937b-2db98ff8e91b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:06:26.246968 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f13500a-bce9-4356-937b-2db98ff8e91b None admin] RBAC: Authorization granted {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:06:26.258157 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: [pid: 88550|app: 0|req: 271/522] 10.222.0.26 () {56 vars in 1148 bytes} [Wed Aug 17 19:06:26 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 19:06:26.259001 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f13500a-bce9-4356-937b-2db98ff8e91b None admin] Authenticating user token {{(pid=88550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:06:26.272878 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d254be1-9417-4927-b326-9c12ac23c83d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '819d41a279e64291acc60de51e1530ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:06:26.273501 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d254be1-9417-4927-b326-9c12ac23c83d None admin] REQUEST_METHOD: `GET` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:06:26.273781 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d254be1-9417-4927-b326-9c12ac23c83d None admin] SCRIPT_NAME: `/identity` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:06:26.274056 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d254be1-9417-4927-b326-9c12ac23c83d None admin] PATH_INFO: `/v3/projects/service` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:06:26.281608 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d254be1-9417-4927-b326-9c12ac23c83d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:06:26.283087 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d254be1-9417-4927-b326-9c12ac23c83d None admin] RBAC: Authorization granted {{(pid=88551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:06:26.294685 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application [None req-1d254be1-9417-4927-b326-9c12ac23c83d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 17 19:06:26.294685 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 19:06:26.294685 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 19:06:26.294685 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 19:06:26.294685 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 19:06:26.294685 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 19:06:26.294685 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 19:06:26.294685 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 19:06:26.294685 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 19:06:26.294685 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 19:06:26.294685 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 19:06:26.294685 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 19:06:26.294685 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 17 19:06:26.294685 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 17 19:06:26.294685 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 17 19:06:26.295896 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 17 19:06:26.295896 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 19:06:26.295896 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 19:06:26.295896 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 19:06:26.295896 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 19:06:26.295896 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 19:06:26.295896 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 19:06:26.295896 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 19:06:26.295896 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application with Lock( Aug 17 19:06:26.295896 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 19:06:26.295896 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application return self._enter() Aug 17 19:06:26.295896 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 19:06:26.295896 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 19:06:26.295896 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 19:06:26.295896 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application return self.creator() Aug 17 19:06:26.295896 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 19:06:26.295896 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application created_value = creator( Aug 17 19:06:26.297100 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 17 19:06:26.297100 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 17 19:06:26.297100 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 17 19:06:26.297100 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 17 19:06:26.297100 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 17 19:06:26.297100 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 17 19:06:26.297100 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 17 19:06:26.297100 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application Aug 17 19:06:26.297100 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: [pid: 88551|app: 0|req: 252/523] 10.222.0.26 () {56 vars in 1111 bytes} [Wed Aug 17 19:06:26 2022] GET /identity/v3/projects/service => generated 88 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 19:06:26.297100 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d254be1-9417-4927-b326-9c12ac23c83d None admin] Authenticating user token {{(pid=88551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:06:26.362175 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f13500a-bce9-4356-937b-2db98ff8e91b None admin] Validating token access rules against request {{(pid=88550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:06:26.388495 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG dbcounter [-] [88551] Writing DB stats keystone:SELECT=100 {{(pid=88551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:06:26.395867 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93ef0ce8-7044-4438-94ab-2ea601f75c8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '819d41a279e64291acc60de51e1530ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:06:26.396468 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ef0ce8-7044-4438-94ab-2ea601f75c8c None admin] REQUEST_METHOD: `GET` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:06:26.396744 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ef0ce8-7044-4438-94ab-2ea601f75c8c None admin] SCRIPT_NAME: `/identity` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:06:26.397018 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ef0ce8-7044-4438-94ab-2ea601f75c8c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:06:26.397736 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93ef0ce8-7044-4438-94ab-2ea601f75c8c None admin] RBAC: Adding query filter params (role.id=c798e3cf305b42dc8579aac6f3229a4b, scope.project.id=4bbf6c5abd684d899d09a08b0847d81c, user.id=9ae23e7a10d54989a25c9f3019184d01) {{(pid=88550) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 19:06:26.398052 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93ef0ce8-7044-4438-94ab-2ea601f75c8c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:06:26.399589 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93ef0ce8-7044-4438-94ab-2ea601f75c8c None admin] RBAC: Authorization granted {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:06:26.402326 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG dbcounter [-] [88550] Writing DB stats keystone:SELECT=100 {{(pid=88550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:06:26.406881 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d254be1-9417-4927-b326-9c12ac23c83d None admin] Validating token access rules against request {{(pid=88551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:06:26.407680 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: [pid: 88550|app: 0|req: 272/524] 10.222.0.26 () {56 vars in 1374 bytes} [Wed Aug 17 19:06:26 2022] GET /identity/v3/role_assignments?user.id=9ae23e7a10d54989a25c9f3019184d01&scope.project.id=4bbf6c5abd684d899d09a08b0847d81c&role.id=c798e3cf305b42dc8579aac6f3229a4b => generated 259 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 19:06:26.408515 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93ef0ce8-7044-4438-94ab-2ea601f75c8c None admin] Authenticating user token {{(pid=88550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:06:26.454259 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9170769-164c-4a09-9272-3e1233d6acdf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '819d41a279e64291acc60de51e1530ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:06:26.454810 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9170769-164c-4a09-9272-3e1233d6acdf None admin] REQUEST_METHOD: `GET` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:06:26.455086 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9170769-164c-4a09-9272-3e1233d6acdf None admin] SCRIPT_NAME: `/identity` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:06:26.455354 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9170769-164c-4a09-9272-3e1233d6acdf None admin] PATH_INFO: `/v3/domains` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:06:26.456012 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9170769-164c-4a09-9272-3e1233d6acdf None admin] RBAC: Adding query filter params (name=Default) {{(pid=88551) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 19:06:26.456400 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9170769-164c-4a09-9272-3e1233d6acdf None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:06:26.458506 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9170769-164c-4a09-9272-3e1233d6acdf None admin] RBAC: Authorization granted {{(pid=88551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:06:26.477167 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: [pid: 88551|app: 0|req: 253/525] 10.222.0.26 () {56 vars in 1109 bytes} [Wed Aug 17 19:06:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 19:06:26.478155 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9170769-164c-4a09-9272-3e1233d6acdf None admin] Authenticating user token {{(pid=88551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:06:26.554809 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93ef0ce8-7044-4438-94ab-2ea601f75c8c None admin] Validating token access rules against request {{(pid=88550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:06:26.597879 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79bdf295-66d8-4f2c-bf7c-343b893ce5a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '819d41a279e64291acc60de51e1530ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:06:26.598494 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79bdf295-66d8-4f2c-bf7c-343b893ce5a8 None admin] REQUEST_METHOD: `GET` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:06:26.599484 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79bdf295-66d8-4f2c-bf7c-343b893ce5a8 None admin] SCRIPT_NAME: `/identity` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:06:26.599890 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79bdf295-66d8-4f2c-bf7c-343b893ce5a8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:06:26.600497 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79bdf295-66d8-4f2c-bf7c-343b893ce5a8 None admin] RBAC: Adding query filter params (role.id=c798e3cf305b42dc8579aac6f3229a4b, scope.project.id=4bbf6c5abd684d899d09a08b0847d81c, user.id=5f32f6111c1c4f1f86c2185bde99a368) {{(pid=88550) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 19:06:26.600803 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79bdf295-66d8-4f2c-bf7c-343b893ce5a8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:06:26.602258 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79bdf295-66d8-4f2c-bf7c-343b893ce5a8 None admin] RBAC: Authorization granted {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:06:26.609328 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: [pid: 88550|app: 0|req: 273/526] 10.222.0.26 () {56 vars in 1374 bytes} [Wed Aug 17 19:06:26 2022] GET /identity/v3/role_assignments?user.id=5f32f6111c1c4f1f86c2185bde99a368&scope.project.id=4bbf6c5abd684d899d09a08b0847d81c&role.id=c798e3cf305b42dc8579aac6f3229a4b => generated 259 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 19:06:26.610033 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79bdf295-66d8-4f2c-bf7c-343b893ce5a8 None admin] Authenticating user token {{(pid=88550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:06:26.617945 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9170769-164c-4a09-9272-3e1233d6acdf None admin] Validating token access rules against request {{(pid=88551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:06:26.658869 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba00dbfa-6f02-486c-a4a4-7d52f4400d38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '819d41a279e64291acc60de51e1530ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:06:26.659490 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba00dbfa-6f02-486c-a4a4-7d52f4400d38 None admin] REQUEST_METHOD: `GET` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:06:26.659770 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba00dbfa-6f02-486c-a4a4-7d52f4400d38 None admin] SCRIPT_NAME: `/identity` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:06:26.660045 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba00dbfa-6f02-486c-a4a4-7d52f4400d38 None admin] PATH_INFO: `/v3/projects` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:06:26.660756 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba00dbfa-6f02-486c-a4a4-7d52f4400d38 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88551) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 19:06:26.661062 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba00dbfa-6f02-486c-a4a4-7d52f4400d38 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:06:26.662569 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba00dbfa-6f02-486c-a4a4-7d52f4400d38 None admin] RBAC: Authorization granted {{(pid=88551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:06:26.683585 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: [pid: 88551|app: 0|req: 254/527] 10.222.0.26 () {56 vars in 1148 bytes} [Wed Aug 17 19:06:26 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 19:06:26.689812 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba00dbfa-6f02-486c-a4a4-7d52f4400d38 None admin] Authenticating user token {{(pid=88551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:06:26.693893 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG dbcounter [-] [88551] Writing DB stats keystone:SELECT=100 {{(pid=88551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:06:26.696337 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG dbcounter [-] [88550] Writing DB stats keystone:SELECT=100 {{(pid=88550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:06:26.782388 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79bdf295-66d8-4f2c-bf7c-343b893ce5a8 None admin] Validating token access rules against request {{(pid=88550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:06:26.831282 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b62a33bd-b59c-4bcf-bdde-5b5e4cb4d603 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '819d41a279e64291acc60de51e1530ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:06:26.831931 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba00dbfa-6f02-486c-a4a4-7d52f4400d38 None admin] Validating token access rules against request {{(pid=88551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:06:26.832361 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b62a33bd-b59c-4bcf-bdde-5b5e4cb4d603 None admin] REQUEST_METHOD: `GET` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:06:26.832846 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b62a33bd-b59c-4bcf-bdde-5b5e4cb4d603 None admin] SCRIPT_NAME: `/identity` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:06:26.833132 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b62a33bd-b59c-4bcf-bdde-5b5e4cb4d603 None admin] PATH_INFO: `/v3/projects/service` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:06:26.846648 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b62a33bd-b59c-4bcf-bdde-5b5e4cb4d603 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:06:26.848950 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b62a33bd-b59c-4bcf-bdde-5b5e4cb4d603 None admin] RBAC: Authorization granted {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:06:26.865426 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application [None req-b62a33bd-b59c-4bcf-bdde-5b5e4cb4d603 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 17 19:06:26.865426 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 19:06:26.865426 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 19:06:26.865426 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 19:06:26.865426 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 19:06:26.865426 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 19:06:26.865426 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 19:06:26.865426 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 19:06:26.865426 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 19:06:26.865426 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 19:06:26.865426 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 19:06:26.865426 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 19:06:26.865426 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 17 19:06:26.865426 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 17 19:06:26.865426 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 17 19:06:26.866397 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 17 19:06:26.866397 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 19:06:26.866397 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 19:06:26.866397 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 19:06:26.866397 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 19:06:26.866397 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 19:06:26.866397 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 19:06:26.866397 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 19:06:26.866397 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application with Lock( Aug 17 19:06:26.866397 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 19:06:26.866397 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return self._enter() Aug 17 19:06:26.866397 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 19:06:26.866397 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 19:06:26.866397 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 19:06:26.866397 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return self.creator() Aug 17 19:06:26.866397 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 19:06:26.866397 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application created_value = creator( Aug 17 19:06:26.867594 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 17 19:06:26.867594 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 17 19:06:26.867594 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 17 19:06:26.867594 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 17 19:06:26.867594 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 17 19:06:26.867594 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 17 19:06:26.867594 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 17 19:06:26.867594 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application Aug 17 19:06:26.867594 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: [pid: 88550|app: 0|req: 274/528] 10.222.0.26 () {56 vars in 1111 bytes} [Wed Aug 17 19:06:26 2022] GET /identity/v3/projects/service => generated 88 bytes in 258 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 19:06:26.872588 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b62a33bd-b59c-4bcf-bdde-5b5e4cb4d603 None admin] Authenticating user token {{(pid=88550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:06:26.880282 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-031fae0b-8fd9-419f-9958-1484daab7b3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '819d41a279e64291acc60de51e1530ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:06:26.881686 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-031fae0b-8fd9-419f-9958-1484daab7b3a None admin] REQUEST_METHOD: `GET` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:06:26.882172 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-031fae0b-8fd9-419f-9958-1484daab7b3a None admin] SCRIPT_NAME: `/identity` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:06:26.883367 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-031fae0b-8fd9-419f-9958-1484daab7b3a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:06:26.884395 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-031fae0b-8fd9-419f-9958-1484daab7b3a None admin] RBAC: Adding query filter params (role.id=c798e3cf305b42dc8579aac6f3229a4b, scope.project.id=4bbf6c5abd684d899d09a08b0847d81c, user.id=0a7ec0aa480147f897f8a76b5b29f3c4) {{(pid=88551) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 19:06:26.884905 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-031fae0b-8fd9-419f-9958-1484daab7b3a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:06:26.887860 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-031fae0b-8fd9-419f-9958-1484daab7b3a None admin] RBAC: Authorization granted {{(pid=88551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:06:26.896751 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: [pid: 88551|app: 0|req: 255/529] 10.222.0.26 () {56 vars in 1374 bytes} [Wed Aug 17 19:06:26 2022] GET /identity/v3/role_assignments?user.id=0a7ec0aa480147f897f8a76b5b29f3c4&scope.project.id=4bbf6c5abd684d899d09a08b0847d81c&role.id=c798e3cf305b42dc8579aac6f3229a4b => generated 259 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 17 19:06:27.001768 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b62a33bd-b59c-4bcf-bdde-5b5e4cb4d603 None admin] Validating token access rules against request {{(pid=88550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:06:27.028911 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG dbcounter [-] [88550] Writing DB stats keystone:SELECT=100 {{(pid=88550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:06:27.042354 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8785f028-8296-47d7-af21-a5c3fbbbae47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '819d41a279e64291acc60de51e1530ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:06:27.043235 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8785f028-8296-47d7-af21-a5c3fbbbae47 None admin] REQUEST_METHOD: `GET` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:06:27.043646 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8785f028-8296-47d7-af21-a5c3fbbbae47 None admin] SCRIPT_NAME: `/identity` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:06:27.050013 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8785f028-8296-47d7-af21-a5c3fbbbae47 None admin] PATH_INFO: `/v3/projects` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:06:27.050013 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8785f028-8296-47d7-af21-a5c3fbbbae47 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88550) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 19:06:27.050013 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8785f028-8296-47d7-af21-a5c3fbbbae47 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:06:27.050013 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8785f028-8296-47d7-af21-a5c3fbbbae47 None admin] RBAC: Authorization granted {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:06:27.062344 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: [pid: 88550|app: 0|req: 275/530] 10.222.0.26 () {56 vars in 1148 bytes} [Wed Aug 17 19:06:26 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 17 19:06:27.068164 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-031fae0b-8fd9-419f-9958-1484daab7b3a None admin] Authenticating user token {{(pid=88551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:06:27.146149 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG dbcounter [-] [88551] Writing DB stats keystone:SELECT=100 {{(pid=88551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:06:27.186220 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-031fae0b-8fd9-419f-9958-1484daab7b3a None admin] Validating token access rules against request {{(pid=88551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:06:27.222822 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eca6ea2-eb46-4e75-8f8a-5787db494aa7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '819d41a279e64291acc60de51e1530ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:06:27.223436 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eca6ea2-eb46-4e75-8f8a-5787db494aa7 None admin] REQUEST_METHOD: `GET` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:06:27.223717 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eca6ea2-eb46-4e75-8f8a-5787db494aa7 None admin] SCRIPT_NAME: `/identity` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:06:27.223990 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eca6ea2-eb46-4e75-8f8a-5787db494aa7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:06:27.224723 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eca6ea2-eb46-4e75-8f8a-5787db494aa7 None admin] RBAC: Adding query filter params (role.id=c798e3cf305b42dc8579aac6f3229a4b, scope.project.id=4bbf6c5abd684d899d09a08b0847d81c, user.id=8240f6e0b65545708f07e040c09e1490) {{(pid=88551) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 19:06:27.225032 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eca6ea2-eb46-4e75-8f8a-5787db494aa7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:06:27.226574 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eca6ea2-eb46-4e75-8f8a-5787db494aa7 None admin] RBAC: Authorization granted {{(pid=88551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:06:27.233163 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: [pid: 88551|app: 0|req: 256/531] 10.222.0.26 () {56 vars in 1374 bytes} [Wed Aug 17 19:06:27 2022] GET /identity/v3/role_assignments?user.id=8240f6e0b65545708f07e040c09e1490&scope.project.id=4bbf6c5abd684d899d09a08b0847d81c&role.id=c798e3cf305b42dc8579aac6f3229a4b => generated 259 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 19:06:28.718726 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a9c29a-20ef-418a-8f1f-6aeb6d5cc44e None None] REQUEST_METHOD: `GET` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:06:28.719765 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a9c29a-20ef-418a-8f1f-6aeb6d5cc44e None None] SCRIPT_NAME: `/identity` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:06:28.720251 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a9c29a-20ef-418a-8f1f-6aeb6d5cc44e None None] PATH_INFO: `/` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:06:28.722078 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: [pid: 88550|app: 0|req: 276/532] 10.222.0.26 () {54 vars in 927 bytes} [Wed Aug 17 19:06:28 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 19:06:28.727957 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e72ab09-60ea-4d99-81a4-ab5176b0a44b None None] REQUEST_METHOD: `POST` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:06:28.728836 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e72ab09-60ea-4d99-81a4-ab5176b0a44b None None] SCRIPT_NAME: `/identity` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:06:28.729318 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e72ab09-60ea-4d99-81a4-ab5176b0a44b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:06:28.749422 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.auth.core [None req-5e72ab09-60ea-4d99-81a4-ab5176b0a44b None None] MFA Rules not processed for user `819d41a279e64291acc60de51e1530ae`. Rule list: `[]` (Enabled: `True`). {{(pid=88551) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 19:06:28.751103 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.common.fernet_utils [None req-5e72ab09-60ea-4d99-81a4-ab5176b0a44b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:06:28.837046 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: [pid: 88551|app: 0|req: 257/533] 10.222.0.26 () {58 vars in 1024 bytes} [Wed Aug 17 19:06:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 17 19:06:28.961674 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22bf6f6a-3120-4705-bfbc-4c285f0a513b None None] REQUEST_METHOD: `GET` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:06:28.962093 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22bf6f6a-3120-4705-bfbc-4c285f0a513b None None] SCRIPT_NAME: `/identity` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:06:28.962443 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22bf6f6a-3120-4705-bfbc-4c285f0a513b None None] PATH_INFO: `/` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:06:28.964236 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: [pid: 88550|app: 0|req: 277/534] 10.222.0.26 () {54 vars in 927 bytes} [Wed Aug 17 19:06:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 19:06:28.970293 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c88c734d-bdf3-4b63-8cbd-650ce5a255db None None] REQUEST_METHOD: `POST` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:06:28.970618 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c88c734d-bdf3-4b63-8cbd-650ce5a255db None None] SCRIPT_NAME: `/identity` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:06:28.970900 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c88c734d-bdf3-4b63-8cbd-650ce5a255db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:06:28.989718 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.auth.core [None req-c88c734d-bdf3-4b63-8cbd-650ce5a255db None None] MFA Rules not processed for user `819d41a279e64291acc60de51e1530ae`. Rule list: `[]` (Enabled: `True`). {{(pid=88551) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 19:06:28.990928 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.common.fernet_utils [None req-c88c734d-bdf3-4b63-8cbd-650ce5a255db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:06:29.054182 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG dbcounter [-] [88551] Writing DB stats keystone:SELECT=100 {{(pid=88551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:06:29.070675 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: [pid: 88551|app: 0|req: 258/535] 10.222.0.26 () {58 vars in 1024 bytes} [Wed Aug 17 19:06:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 17 19:06:29.168996 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-921a85b3-e044-47ee-987e-e82f4e2f9810 None None] REQUEST_METHOD: `GET` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:06:29.169310 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-921a85b3-e044-47ee-987e-e82f4e2f9810 None None] SCRIPT_NAME: `/identity` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:06:29.169545 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-921a85b3-e044-47ee-987e-e82f4e2f9810 None None] PATH_INFO: `/` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:06:29.171215 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: [pid: 88550|app: 0|req: 278/536] 10.222.0.26 () {54 vars in 927 bytes} [Wed Aug 17 19:06:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 19:06:29.176038 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca82807e-7405-4e75-a147-022a5f7a7644 None None] REQUEST_METHOD: `POST` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:06:29.176446 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca82807e-7405-4e75-a147-022a5f7a7644 None None] SCRIPT_NAME: `/identity` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:06:29.176790 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca82807e-7405-4e75-a147-022a5f7a7644 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:06:29.189617 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-921a85b3-e044-47ee-987e-e82f4e2f9810 None None] Authenticating user token {{(pid=88550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:06:29.196021 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.auth.core [None req-ca82807e-7405-4e75-a147-022a5f7a7644 None None] MFA Rules not processed for user `819d41a279e64291acc60de51e1530ae`. Rule list: `[]` (Enabled: `True`). {{(pid=88551) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 19:06:29.197201 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.common.fernet_utils [None req-ca82807e-7405-4e75-a147-022a5f7a7644 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:06:29.271806 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: [pid: 88551|app: 0|req: 259/537] 10.222.0.26 () {58 vars in 1024 bytes} [Wed Aug 17 19:06:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 17 19:06:29.319788 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-921a85b3-e044-47ee-987e-e82f4e2f9810 None None] Validating token access rules against request {{(pid=88550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:06:29.357669 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8414d035-1420-4499-8c93-5d5e70b4fe14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '819d41a279e64291acc60de51e1530ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:06:29.358291 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8414d035-1420-4499-8c93-5d5e70b4fe14 None admin] REQUEST_METHOD: `GET` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:06:29.358604 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8414d035-1420-4499-8c93-5d5e70b4fe14 None admin] SCRIPT_NAME: `/identity` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:06:29.358933 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8414d035-1420-4499-8c93-5d5e70b4fe14 None admin] PATH_INFO: `/v3/roles/service` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:06:29.369787 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8414d035-1420-4499-8c93-5d5e70b4fe14 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 17 19:06:29.374718 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application [None req-8414d035-1420-4499-8c93-5d5e70b4fe14 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 17 19:06:29.374718 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 19:06:29.374718 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 19:06:29.374718 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 19:06:29.374718 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 19:06:29.374718 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 19:06:29.374718 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 19:06:29.374718 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 19:06:29.374718 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 19:06:29.374718 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 19:06:29.374718 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 19:06:29.374718 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 19:06:29.374718 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 17 19:06:29.374718 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 17 19:06:29.374718 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 17 19:06:29.374718 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 17 19:06:29.375606 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 17 19:06:29.375606 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 17 19:06:29.375606 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 17 19:06:29.375606 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 17 19:06:29.375606 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 19:06:29.375606 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 19:06:29.375606 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 19:06:29.375606 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 19:06:29.375606 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 19:06:29.375606 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 19:06:29.375606 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 19:06:29.375606 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application with Lock( Aug 17 19:06:29.375606 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 19:06:29.375606 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return self._enter() Aug 17 19:06:29.375606 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 19:06:29.375606 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 19:06:29.376527 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 19:06:29.376527 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return self.creator() Aug 17 19:06:29.376527 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 19:06:29.376527 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application created_value = creator( Aug 17 19:06:29.376527 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 17 19:06:29.376527 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 17 19:06:29.376527 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 17 19:06:29.376527 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 17 19:06:29.376527 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 17 19:06:29.376527 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 17 19:06:29.376527 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 17 19:06:29.376527 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application Aug 17 19:06:29.376527 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: [pid: 88550|app: 0|req: 279/538] 10.222.0.26 () {56 vars in 1102 bytes} [Wed Aug 17 19:06:29 2022] GET /identity/v3/roles/service => generated 85 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 19:06:29.383743 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca82807e-7405-4e75-a147-022a5f7a7644 None None] Authenticating user token {{(pid=88551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:06:29.414755 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8414d035-1420-4499-8c93-5d5e70b4fe14 None admin] Authenticating user token {{(pid=88550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:06:29.460911 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG dbcounter [-] [88550] Writing DB stats keystone:SELECT=100 {{(pid=88550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:06:29.495282 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca82807e-7405-4e75-a147-022a5f7a7644 None None] Validating token access rules against request {{(pid=88551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:06:29.523492 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG dbcounter [-] [88551] Writing DB stats keystone:SELECT=100 {{(pid=88551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:06:29.525106 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8414d035-1420-4499-8c93-5d5e70b4fe14 None admin] Validating token access rules against request {{(pid=88550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:06:29.539338 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-942c5409-2073-4f11-91ff-c1e2363f4b54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '819d41a279e64291acc60de51e1530ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:06:29.540186 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-942c5409-2073-4f11-91ff-c1e2363f4b54 None admin] REQUEST_METHOD: `GET` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:06:29.540614 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-942c5409-2073-4f11-91ff-c1e2363f4b54 None admin] SCRIPT_NAME: `/identity` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:06:29.541151 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-942c5409-2073-4f11-91ff-c1e2363f4b54 None admin] PATH_INFO: `/v3/roles` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:06:29.542019 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-942c5409-2073-4f11-91ff-c1e2363f4b54 None admin] RBAC: Adding query filter params (name=service) {{(pid=88551) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 19:06:29.542716 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-942c5409-2073-4f11-91ff-c1e2363f4b54 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:06:29.545075 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-942c5409-2073-4f11-91ff-c1e2363f4b54 None admin] RBAC: Authorization granted {{(pid=88551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:06:29.559199 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: [pid: 88551|app: 0|req: 260/539] 10.222.0.26 () {56 vars in 1103 bytes} [Wed Aug 17 19:06:29 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 19:06:29.561969 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-209e88d9-d947-41d4-aeb7-518f83fae71e None None] REQUEST_METHOD: `GET` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:06:29.562515 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-209e88d9-d947-41d4-aeb7-518f83fae71e None None] SCRIPT_NAME: `/identity` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:06:29.563037 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-209e88d9-d947-41d4-aeb7-518f83fae71e None None] PATH_INFO: `/` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:06:29.563365 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7a3db1b-d1a9-4629-9a35-21c79b373985 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '819d41a279e64291acc60de51e1530ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:06:29.563995 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a3db1b-d1a9-4629-9a35-21c79b373985 None admin] REQUEST_METHOD: `GET` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:06:29.564282 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a3db1b-d1a9-4629-9a35-21c79b373985 None admin] SCRIPT_NAME: `/identity` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:06:29.564560 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a3db1b-d1a9-4629-9a35-21c79b373985 None admin] PATH_INFO: `/v3/roles/service` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:06:29.565632 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: [pid: 88551|app: 0|req: 261/540] 10.222.0.26 () {54 vars in 927 bytes} [Wed Aug 17 19:06:29 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 19:06:29.566577 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-209e88d9-d947-41d4-aeb7-518f83fae71e None None] Authenticating user token {{(pid=88551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:06:29.578974 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7a3db1b-d1a9-4629-9a35-21c79b373985 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 17 19:06:29.584160 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application [None req-a7a3db1b-d1a9-4629-9a35-21c79b373985 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 17 19:06:29.584160 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 19:06:29.584160 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 19:06:29.584160 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 19:06:29.584160 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 19:06:29.584160 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 19:06:29.584160 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 19:06:29.584160 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 19:06:29.584160 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 19:06:29.584160 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 19:06:29.584160 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 19:06:29.584160 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 19:06:29.584160 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 17 19:06:29.584160 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 17 19:06:29.584160 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 17 19:06:29.584160 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 17 19:06:29.585319 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 17 19:06:29.585319 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 17 19:06:29.585319 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 17 19:06:29.585319 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 17 19:06:29.585319 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 19:06:29.585319 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 19:06:29.585319 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 19:06:29.585319 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 19:06:29.585319 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 19:06:29.585319 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 19:06:29.585319 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 19:06:29.585319 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application with Lock( Aug 17 19:06:29.585319 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 19:06:29.585319 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return self._enter() Aug 17 19:06:29.585319 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 19:06:29.585319 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 19:06:29.586365 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 19:06:29.586365 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return self.creator() Aug 17 19:06:29.586365 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 19:06:29.586365 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application created_value = creator( Aug 17 19:06:29.586365 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 17 19:06:29.586365 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 17 19:06:29.586365 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 17 19:06:29.586365 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 17 19:06:29.586365 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 17 19:06:29.586365 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 17 19:06:29.586365 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 17 19:06:29.586365 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application Aug 17 19:06:29.586365 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: [pid: 88550|app: 0|req: 280/541] 10.222.0.26 () {56 vars in 1102 bytes} [Wed Aug 17 19:06:29 2022] GET /identity/v3/roles/service => generated 85 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 17 19:06:29.587301 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4211ab00-f581-4d15-a30d-c58f710cafb2 None None] REQUEST_METHOD: `POST` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:06:29.587301 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4211ab00-f581-4d15-a30d-c58f710cafb2 None None] SCRIPT_NAME: `/identity` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:06:29.587301 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4211ab00-f581-4d15-a30d-c58f710cafb2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:06:29.605100 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.auth.core [None req-4211ab00-f581-4d15-a30d-c58f710cafb2 None None] MFA Rules not processed for user `819d41a279e64291acc60de51e1530ae`. Rule list: `[]` (Enabled: `True`). {{(pid=88550) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 19:06:29.606315 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.common.fernet_utils [None req-4211ab00-f581-4d15-a30d-c58f710cafb2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:06:29.673313 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: [pid: 88550|app: 0|req: 281/542] 10.222.0.26 () {58 vars in 1024 bytes} [Wed Aug 17 19:06:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 17 19:06:29.674217 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4211ab00-f581-4d15-a30d-c58f710cafb2 None None] Authenticating user token {{(pid=88550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:06:29.683501 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-209e88d9-d947-41d4-aeb7-518f83fae71e None None] Validating token access rules against request {{(pid=88551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:06:29.716328 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG dbcounter [-] [88550] Writing DB stats keystone:SELECT=100 {{(pid=88550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:06:29.728858 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5259b3a-d049-47d1-a60b-db4ec556fe9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '819d41a279e64291acc60de51e1530ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:06:29.729589 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5259b3a-d049-47d1-a60b-db4ec556fe9a None admin] REQUEST_METHOD: `GET` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:06:29.729962 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5259b3a-d049-47d1-a60b-db4ec556fe9a None admin] SCRIPT_NAME: `/identity` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:06:29.730278 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5259b3a-d049-47d1-a60b-db4ec556fe9a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:06:29.742068 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5259b3a-d049-47d1-a60b-db4ec556fe9a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:06:29.743554 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5259b3a-d049-47d1-a60b-db4ec556fe9a None admin] RBAC: Authorization granted {{(pid=88551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:06:29.757626 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application [None req-b5259b3a-d049-47d1-a60b-db4ec556fe9a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 19:06:29.757626 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 19:06:29.757626 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 19:06:29.757626 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 19:06:29.757626 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 19:06:29.757626 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 19:06:29.757626 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 19:06:29.757626 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 19:06:29.757626 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 19:06:29.757626 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 19:06:29.757626 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 19:06:29.757626 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 19:06:29.757626 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 17 19:06:29.757626 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 17 19:06:29.757626 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 17 19:06:29.757626 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 17 19:06:29.758605 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 19:06:29.758605 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 19:06:29.758605 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 19:06:29.758605 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 19:06:29.758605 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 19:06:29.758605 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 19:06:29.758605 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 19:06:29.758605 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application with Lock( Aug 17 19:06:29.758605 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 19:06:29.758605 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application return self._enter() Aug 17 19:06:29.758605 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 19:06:29.758605 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 19:06:29.758605 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 19:06:29.758605 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application return self.creator() Aug 17 19:06:29.758605 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 19:06:29.758605 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application created_value = creator( Aug 17 19:06:29.758605 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 17 19:06:29.760262 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 17 19:06:29.760262 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 19:06:29.760262 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application Aug 17 19:06:29.760262 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: [pid: 88551|app: 0|req: 262/543] 10.222.0.26 () {56 vars in 1108 bytes} [Wed Aug 17 19:06:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 19:06:29.760262 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5259b3a-d049-47d1-a60b-db4ec556fe9a None admin] Authenticating user token {{(pid=88551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:06:29.800466 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG dbcounter [-] [88551] Writing DB stats keystone:SELECT=100 {{(pid=88551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:06:29.813142 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4211ab00-f581-4d15-a30d-c58f710cafb2 None None] Validating token access rules against request {{(pid=88550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:06:29.852352 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7538a657-709c-4785-825f-dd47e75d8d32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '819d41a279e64291acc60de51e1530ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:06:29.853029 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7538a657-709c-4785-825f-dd47e75d8d32 None admin] REQUEST_METHOD: `GET` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:06:29.853340 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7538a657-709c-4785-825f-dd47e75d8d32 None admin] SCRIPT_NAME: `/identity` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:06:29.853623 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7538a657-709c-4785-825f-dd47e75d8d32 None admin] PATH_INFO: `/v3/roles` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:06:29.854393 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7538a657-709c-4785-825f-dd47e75d8d32 None admin] RBAC: Adding query filter params (name=service) {{(pid=88550) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 19:06:29.854773 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7538a657-709c-4785-825f-dd47e75d8d32 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:06:29.856472 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7538a657-709c-4785-825f-dd47e75d8d32 None admin] RBAC: Authorization granted {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:06:29.870357 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: [pid: 88550|app: 0|req: 282/544] 10.222.0.26 () {56 vars in 1103 bytes} [Wed Aug 17 19:06:29 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 19:06:29.870357 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7538a657-709c-4785-825f-dd47e75d8d32 None admin] Authenticating user token {{(pid=88550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:06:29.873505 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5259b3a-d049-47d1-a60b-db4ec556fe9a None admin] Validating token access rules against request {{(pid=88551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:06:29.912106 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92e0c24a-5f22-4899-a23c-f3be7a1a5ee1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '819d41a279e64291acc60de51e1530ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:06:29.912774 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e0c24a-5f22-4899-a23c-f3be7a1a5ee1 None admin] REQUEST_METHOD: `GET` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:06:29.913064 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e0c24a-5f22-4899-a23c-f3be7a1a5ee1 None admin] SCRIPT_NAME: `/identity` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:06:29.917403 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e0c24a-5f22-4899-a23c-f3be7a1a5ee1 None admin] PATH_INFO: `/v3/roles/service` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:06:29.933169 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92e0c24a-5f22-4899-a23c-f3be7a1a5ee1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 17 19:06:29.938366 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application [None req-92e0c24a-5f22-4899-a23c-f3be7a1a5ee1 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 17 19:06:29.938366 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 19:06:29.938366 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 19:06:29.938366 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 19:06:29.938366 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 19:06:29.938366 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 19:06:29.938366 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 19:06:29.938366 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 19:06:29.938366 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 19:06:29.938366 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 19:06:29.938366 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 19:06:29.938366 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 19:06:29.938366 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 17 19:06:29.938366 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 17 19:06:29.938366 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 17 19:06:29.938366 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 17 19:06:29.939642 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 17 19:06:29.939642 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 17 19:06:29.939642 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 17 19:06:29.939642 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 17 19:06:29.939642 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 19:06:29.939642 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 19:06:29.939642 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 19:06:29.939642 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 19:06:29.939642 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 19:06:29.939642 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 19:06:29.939642 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 19:06:29.939642 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application with Lock( Aug 17 19:06:29.939642 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 19:06:29.939642 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application return self._enter() Aug 17 19:06:29.939642 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 19:06:29.939642 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 19:06:29.940836 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 19:06:29.940836 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application return self.creator() Aug 17 19:06:29.940836 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 19:06:29.940836 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application created_value = creator( Aug 17 19:06:29.940836 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 17 19:06:29.940836 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 17 19:06:29.940836 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 17 19:06:29.940836 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 17 19:06:29.940836 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 17 19:06:29.940836 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 17 19:06:29.940836 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 17 19:06:29.940836 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application Aug 17 19:06:29.945096 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: [pid: 88551|app: 0|req: 263/545] 10.222.0.26 () {56 vars in 1102 bytes} [Wed Aug 17 19:06:29 2022] GET /identity/v3/roles/service => generated 85 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 19:06:29.950292 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92e0c24a-5f22-4899-a23c-f3be7a1a5ee1 None admin] Authenticating user token {{(pid=88551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:06:29.995257 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG dbcounter [-] [88550] Writing DB stats keystone:SELECT=100 {{(pid=88550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:06:30.004077 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7538a657-709c-4785-825f-dd47e75d8d32 None admin] Validating token access rules against request {{(pid=88550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:06:30.037989 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-424dafa5-cab9-4c86-b2ec-f018161b2565 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '819d41a279e64291acc60de51e1530ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:06:30.038670 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-424dafa5-cab9-4c86-b2ec-f018161b2565 None admin] REQUEST_METHOD: `GET` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:06:30.038954 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-424dafa5-cab9-4c86-b2ec-f018161b2565 None admin] SCRIPT_NAME: `/identity` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:06:30.046855 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-424dafa5-cab9-4c86-b2ec-f018161b2565 None admin] PATH_INFO: `/v3/domains` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:06:30.046855 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-424dafa5-cab9-4c86-b2ec-f018161b2565 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88550) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 19:06:30.046855 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-424dafa5-cab9-4c86-b2ec-f018161b2565 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:06:30.046855 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-424dafa5-cab9-4c86-b2ec-f018161b2565 None admin] RBAC: Authorization granted {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:06:30.051547 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG dbcounter [-] [88551] Writing DB stats keystone:SELECT=100 {{(pid=88551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:06:30.052918 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: [pid: 88550|app: 0|req: 283/546] 10.222.0.26 () {56 vars in 1109 bytes} [Wed Aug 17 19:06:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 19:06:30.053730 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-424dafa5-cab9-4c86-b2ec-f018161b2565 None admin] Authenticating user token {{(pid=88550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:06:30.057857 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92e0c24a-5f22-4899-a23c-f3be7a1a5ee1 None admin] Validating token access rules against request {{(pid=88551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:06:30.093706 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1edca87f-9f33-41b2-91e9-89d52aef75a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '819d41a279e64291acc60de51e1530ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:06:30.094445 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1edca87f-9f33-41b2-91e9-89d52aef75a1 None admin] REQUEST_METHOD: `GET` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:06:30.094821 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1edca87f-9f33-41b2-91e9-89d52aef75a1 None admin] SCRIPT_NAME: `/identity` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:06:30.095104 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1edca87f-9f33-41b2-91e9-89d52aef75a1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:06:30.105047 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1edca87f-9f33-41b2-91e9-89d52aef75a1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:06:30.106573 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1edca87f-9f33-41b2-91e9-89d52aef75a1 None admin] RBAC: Authorization granted {{(pid=88551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:06:30.121157 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application [None req-1edca87f-9f33-41b2-91e9-89d52aef75a1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 19:06:30.121157 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 19:06:30.121157 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 19:06:30.121157 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 19:06:30.121157 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 19:06:30.121157 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 19:06:30.121157 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 19:06:30.121157 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 19:06:30.121157 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 19:06:30.121157 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 19:06:30.121157 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 19:06:30.121157 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 19:06:30.121157 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 17 19:06:30.121157 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 17 19:06:30.121157 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 17 19:06:30.121157 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 17 19:06:30.122077 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 19:06:30.122077 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 19:06:30.122077 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 19:06:30.122077 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 19:06:30.122077 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 19:06:30.122077 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 19:06:30.122077 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 19:06:30.122077 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application with Lock( Aug 17 19:06:30.122077 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 19:06:30.122077 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application return self._enter() Aug 17 19:06:30.122077 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 19:06:30.122077 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 19:06:30.122077 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 19:06:30.122077 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application return self.creator() Aug 17 19:06:30.122077 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 19:06:30.122077 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application created_value = creator( Aug 17 19:06:30.122077 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 17 19:06:30.123024 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 17 19:06:30.123024 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 19:06:30.123024 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application Aug 17 19:06:30.123024 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: [pid: 88551|app: 0|req: 264/547] 10.222.0.26 () {56 vars in 1108 bytes} [Wed Aug 17 19:06:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 19:06:30.123024 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1edca87f-9f33-41b2-91e9-89d52aef75a1 None admin] Authenticating user token {{(pid=88551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:06:30.158086 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-424dafa5-cab9-4c86-b2ec-f018161b2565 None admin] Validating token access rules against request {{(pid=88550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:06:30.192288 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fd17878-3955-4bc0-8a43-8a767c76d7b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '819d41a279e64291acc60de51e1530ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:06:30.192876 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd17878-3955-4bc0-8a43-8a767c76d7b7 None admin] REQUEST_METHOD: `GET` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:06:30.193151 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd17878-3955-4bc0-8a43-8a767c76d7b7 None admin] SCRIPT_NAME: `/identity` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:06:30.193417 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd17878-3955-4bc0-8a43-8a767c76d7b7 None admin] PATH_INFO: `/v3/roles` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:06:30.194064 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fd17878-3955-4bc0-8a43-8a767c76d7b7 None admin] RBAC: Adding query filter params (name=service) {{(pid=88550) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 19:06:30.194355 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fd17878-3955-4bc0-8a43-8a767c76d7b7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:06:30.195756 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fd17878-3955-4bc0-8a43-8a767c76d7b7 None admin] RBAC: Authorization granted {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:06:30.204363 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: [pid: 88550|app: 0|req: 284/548] 10.222.0.26 () {56 vars in 1103 bytes} [Wed Aug 17 19:06:30 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 19:06:30.205145 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fd17878-3955-4bc0-8a43-8a767c76d7b7 None admin] Authenticating user token {{(pid=88550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:06:30.224018 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG dbcounter [-] [88550] Writing DB stats keystone:SELECT=100 {{(pid=88550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:06:30.231330 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1edca87f-9f33-41b2-91e9-89d52aef75a1 None admin] Validating token access rules against request {{(pid=88551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:06:30.267408 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7895d0ba-7493-4022-be33-4fb13dc1765c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '819d41a279e64291acc60de51e1530ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:06:30.268022 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7895d0ba-7493-4022-be33-4fb13dc1765c None admin] REQUEST_METHOD: `GET` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:06:30.268300 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7895d0ba-7493-4022-be33-4fb13dc1765c None admin] SCRIPT_NAME: `/identity` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:06:30.268569 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7895d0ba-7493-4022-be33-4fb13dc1765c None admin] PATH_INFO: `/v3/roles/service` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:06:30.278559 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7895d0ba-7493-4022-be33-4fb13dc1765c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 17 19:06:30.283777 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application [None req-7895d0ba-7493-4022-be33-4fb13dc1765c None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 17 19:06:30.283777 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 19:06:30.283777 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 19:06:30.283777 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 19:06:30.283777 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 19:06:30.283777 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 19:06:30.283777 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 19:06:30.283777 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 19:06:30.283777 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 19:06:30.283777 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 19:06:30.283777 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 19:06:30.283777 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 19:06:30.283777 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 17 19:06:30.283777 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 17 19:06:30.283777 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 17 19:06:30.283777 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 17 19:06:30.284813 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 17 19:06:30.284813 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 17 19:06:30.284813 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 17 19:06:30.284813 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 17 19:06:30.284813 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 19:06:30.284813 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 19:06:30.284813 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 19:06:30.284813 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 19:06:30.284813 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 19:06:30.284813 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 19:06:30.284813 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 19:06:30.284813 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application with Lock( Aug 17 19:06:30.284813 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 19:06:30.284813 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application return self._enter() Aug 17 19:06:30.284813 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 19:06:30.284813 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 19:06:30.285669 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 19:06:30.285669 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application return self.creator() Aug 17 19:06:30.285669 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 19:06:30.285669 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application created_value = creator( Aug 17 19:06:30.285669 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 17 19:06:30.285669 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 17 19:06:30.285669 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 17 19:06:30.285669 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 17 19:06:30.285669 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 17 19:06:30.285669 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 17 19:06:30.285669 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 17 19:06:30.285669 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application Aug 17 19:06:30.285669 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: [pid: 88551|app: 0|req: 265/549] 10.222.0.26 () {56 vars in 1102 bytes} [Wed Aug 17 19:06:30 2022] GET /identity/v3/roles/service => generated 85 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 19:06:30.285669 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7895d0ba-7493-4022-be33-4fb13dc1765c None admin] Authenticating user token {{(pid=88551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:06:30.297006 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG dbcounter [-] [88551] Writing DB stats keystone:SELECT=100 {{(pid=88551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:06:30.308711 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fd17878-3955-4bc0-8a43-8a767c76d7b7 None admin] Validating token access rules against request {{(pid=88550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:06:30.342954 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f4a2113-e18e-4e6c-89f1-07dabab46334 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '819d41a279e64291acc60de51e1530ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:06:30.343576 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f4a2113-e18e-4e6c-89f1-07dabab46334 None admin] REQUEST_METHOD: `GET` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:06:30.343851 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f4a2113-e18e-4e6c-89f1-07dabab46334 None admin] SCRIPT_NAME: `/identity` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:06:30.344133 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f4a2113-e18e-4e6c-89f1-07dabab46334 None admin] PATH_INFO: `/v3/users/nova` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:06:30.351924 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f4a2113-e18e-4e6c-89f1-07dabab46334 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:06:30.353356 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f4a2113-e18e-4e6c-89f1-07dabab46334 None admin] RBAC: Authorization granted {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:06:30.365046 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application [None req-1f4a2113-e18e-4e6c-89f1-07dabab46334 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 17 19:06:30.365046 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 19:06:30.365046 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 19:06:30.365046 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 19:06:30.365046 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 19:06:30.365046 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 19:06:30.365046 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 19:06:30.365046 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 19:06:30.365046 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 19:06:30.365046 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 19:06:30.365046 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 19:06:30.365046 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 19:06:30.365046 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 17 19:06:30.365046 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 17 19:06:30.365046 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 17 19:06:30.365046 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 17 19:06:30.366157 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 19:06:30.366157 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 19:06:30.366157 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 17 19:06:30.366157 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 17 19:06:30.366157 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 17 19:06:30.366157 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 17 19:06:30.366157 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 19:06:30.366157 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 19:06:30.366157 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 19:06:30.366157 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 19:06:30.366157 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 19:06:30.366157 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application with Lock( Aug 17 19:06:30.366157 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 19:06:30.366157 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return self._enter() Aug 17 19:06:30.366157 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 19:06:30.366157 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 19:06:30.366157 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 19:06:30.366157 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return self.creator() Aug 17 19:06:30.367999 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 19:06:30.367999 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application created_value = creator( Aug 17 19:06:30.367999 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 17 19:06:30.367999 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 17 19:06:30.367999 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 17 19:06:30.367999 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 17 19:06:30.367999 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 17 19:06:30.367999 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 17 19:06:30.367999 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 17 19:06:30.367999 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application Aug 17 19:06:30.367999 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: [pid: 88550|app: 0|req: 285/550] 10.222.0.26 () {56 vars in 1093 bytes} [Wed Aug 17 19:06:30 2022] GET /identity/v3/users/nova => generated 82 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 19:06:30.367999 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f4a2113-e18e-4e6c-89f1-07dabab46334 None admin] Authenticating user token {{(pid=88550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:06:30.394610 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7895d0ba-7493-4022-be33-4fb13dc1765c None admin] Validating token access rules against request {{(pid=88551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:06:30.428183 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84d0c50b-1c4f-4d4e-bcff-b414c09f58b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '819d41a279e64291acc60de51e1530ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:06:30.428770 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d0c50b-1c4f-4d4e-bcff-b414c09f58b1 None admin] REQUEST_METHOD: `GET` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:06:30.429053 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d0c50b-1c4f-4d4e-bcff-b414c09f58b1 None admin] SCRIPT_NAME: `/identity` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:06:30.429323 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d0c50b-1c4f-4d4e-bcff-b414c09f58b1 None admin] PATH_INFO: `/v3/domains` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:06:30.429958 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84d0c50b-1c4f-4d4e-bcff-b414c09f58b1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88551) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 19:06:30.430259 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84d0c50b-1c4f-4d4e-bcff-b414c09f58b1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:06:30.431640 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84d0c50b-1c4f-4d4e-bcff-b414c09f58b1 None admin] RBAC: Authorization granted {{(pid=88551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:06:30.444511 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: [pid: 88551|app: 0|req: 266/551] 10.222.0.26 () {56 vars in 1109 bytes} [Wed Aug 17 19:06:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 19:06:30.445234 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84d0c50b-1c4f-4d4e-bcff-b414c09f58b1 None admin] Authenticating user token {{(pid=88551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:06:30.451456 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG dbcounter [-] [88550] Writing DB stats keystone:SELECT=100 {{(pid=88550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:06:30.474530 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f4a2113-e18e-4e6c-89f1-07dabab46334 None admin] Validating token access rules against request {{(pid=88550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:06:30.508664 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04503457-09f1-491b-b0f2-5f5c10af79db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '819d41a279e64291acc60de51e1530ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:06:30.509286 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04503457-09f1-491b-b0f2-5f5c10af79db None admin] REQUEST_METHOD: `GET` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:06:30.509569 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04503457-09f1-491b-b0f2-5f5c10af79db None admin] SCRIPT_NAME: `/identity` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:06:30.509844 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04503457-09f1-491b-b0f2-5f5c10af79db None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:06:30.512034 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG dbcounter [-] [88551] Writing DB stats keystone:SELECT=100 {{(pid=88551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:06:30.520617 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04503457-09f1-491b-b0f2-5f5c10af79db None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:06:30.522064 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04503457-09f1-491b-b0f2-5f5c10af79db None admin] RBAC: Authorization granted {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:06:30.537933 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application [None req-04503457-09f1-491b-b0f2-5f5c10af79db None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 19:06:30.537933 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 19:06:30.537933 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 19:06:30.537933 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 19:06:30.537933 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 19:06:30.537933 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 19:06:30.537933 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 19:06:30.537933 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 19:06:30.537933 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 19:06:30.537933 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 19:06:30.537933 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 19:06:30.537933 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 19:06:30.537933 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 17 19:06:30.537933 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 17 19:06:30.537933 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 17 19:06:30.537933 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 17 19:06:30.539128 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 19:06:30.539128 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 19:06:30.539128 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 19:06:30.539128 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 19:06:30.539128 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 19:06:30.539128 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 19:06:30.539128 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 19:06:30.539128 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application with Lock( Aug 17 19:06:30.539128 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 19:06:30.539128 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return self._enter() Aug 17 19:06:30.539128 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 19:06:30.539128 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 19:06:30.539128 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 19:06:30.539128 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return self.creator() Aug 17 19:06:30.539128 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 19:06:30.539128 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application created_value = creator( Aug 17 19:06:30.539128 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 17 19:06:30.540179 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 17 19:06:30.540179 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 19:06:30.540179 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application Aug 17 19:06:30.540179 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: [pid: 88550|app: 0|req: 286/552] 10.222.0.26 () {56 vars in 1108 bytes} [Wed Aug 17 19:06:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 19:06:30.540179 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04503457-09f1-491b-b0f2-5f5c10af79db None admin] Authenticating user token {{(pid=88550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:06:30.552293 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84d0c50b-1c4f-4d4e-bcff-b414c09f58b1 None admin] Validating token access rules against request {{(pid=88551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:06:30.586232 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce792bc3-8f92-4b58-abf3-7991e5f04bc2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '819d41a279e64291acc60de51e1530ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:06:30.586773 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce792bc3-8f92-4b58-abf3-7991e5f04bc2 None admin] REQUEST_METHOD: `GET` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:06:30.587053 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce792bc3-8f92-4b58-abf3-7991e5f04bc2 None admin] SCRIPT_NAME: `/identity` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:06:30.587323 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce792bc3-8f92-4b58-abf3-7991e5f04bc2 None admin] PATH_INFO: `/v3/roles` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:06:30.587984 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce792bc3-8f92-4b58-abf3-7991e5f04bc2 None admin] RBAC: Adding query filter params (name=service) {{(pid=88551) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 19:06:30.588284 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce792bc3-8f92-4b58-abf3-7991e5f04bc2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:06:30.589636 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce792bc3-8f92-4b58-abf3-7991e5f04bc2 None admin] RBAC: Authorization granted {{(pid=88551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:06:30.598449 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: [pid: 88551|app: 0|req: 267/553] 10.222.0.26 () {56 vars in 1103 bytes} [Wed Aug 17 19:06:30 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 19:06:30.599314 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce792bc3-8f92-4b58-abf3-7991e5f04bc2 None admin] Authenticating user token {{(pid=88551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:06:30.642182 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04503457-09f1-491b-b0f2-5f5c10af79db None admin] Validating token access rules against request {{(pid=88550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:06:30.667195 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG dbcounter [-] [88550] Writing DB stats keystone:SELECT=100 {{(pid=88550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:06:30.676075 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b759a4d-edd3-40d6-ae0b-ffe50d3e2def None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '819d41a279e64291acc60de51e1530ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:06:30.676668 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b759a4d-edd3-40d6-ae0b-ffe50d3e2def None admin] REQUEST_METHOD: `GET` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:06:30.676943 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b759a4d-edd3-40d6-ae0b-ffe50d3e2def None admin] SCRIPT_NAME: `/identity` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:06:30.678411 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b759a4d-edd3-40d6-ae0b-ffe50d3e2def None admin] PATH_INFO: `/v3/users` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:06:30.678411 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b759a4d-edd3-40d6-ae0b-ffe50d3e2def None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=88550) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 19:06:30.678411 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b759a4d-edd3-40d6-ae0b-ffe50d3e2def None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:06:30.679687 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b759a4d-edd3-40d6-ae0b-ffe50d3e2def None admin] RBAC: Authorization granted {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:06:30.697479 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: [pid: 88550|app: 0|req: 287/554] 10.222.0.26 () {56 vars in 1133 bytes} [Wed Aug 17 19:06:30 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 19:06:30.701169 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce792bc3-8f92-4b58-abf3-7991e5f04bc2 None admin] Validating token access rules against request {{(pid=88551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:06:30.702190 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b759a4d-edd3-40d6-ae0b-ffe50d3e2def None admin] Authenticating user token {{(pid=88550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:06:30.729120 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG dbcounter [-] [88551] Writing DB stats keystone:SELECT=100 {{(pid=88551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:06:30.735561 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8db43dec-4c37-4645-8a7e-a861dc94c1b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '819d41a279e64291acc60de51e1530ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:06:30.736179 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db43dec-4c37-4645-8a7e-a861dc94c1b8 None admin] REQUEST_METHOD: `GET` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:06:30.736456 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db43dec-4c37-4645-8a7e-a861dc94c1b8 None admin] SCRIPT_NAME: `/identity` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:06:30.736726 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db43dec-4c37-4645-8a7e-a861dc94c1b8 None admin] PATH_INFO: `/v3/users/glance` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:06:30.744201 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8db43dec-4c37-4645-8a7e-a861dc94c1b8 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=88551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:06:30.745627 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8db43dec-4c37-4645-8a7e-a861dc94c1b8 None admin] RBAC: Authorization granted {{(pid=88551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:06:30.757311 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application [None req-8db43dec-4c37-4645-8a7e-a861dc94c1b8 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Aug 17 19:06:30.757311 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 19:06:30.757311 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 19:06:30.757311 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 19:06:30.757311 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 19:06:30.757311 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 19:06:30.757311 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 19:06:30.757311 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 19:06:30.757311 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 19:06:30.757311 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 19:06:30.757311 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 19:06:30.757311 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 19:06:30.757311 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 17 19:06:30.757311 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 17 19:06:30.757311 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 17 19:06:30.757311 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 17 19:06:30.758574 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 19:06:30.758574 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 19:06:30.758574 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 17 19:06:30.758574 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 17 19:06:30.758574 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 17 19:06:30.758574 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 17 19:06:30.758574 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 19:06:30.758574 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 19:06:30.758574 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 19:06:30.758574 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 19:06:30.758574 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 19:06:30.758574 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application with Lock( Aug 17 19:06:30.758574 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 19:06:30.758574 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application return self._enter() Aug 17 19:06:30.758574 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 19:06:30.758574 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 19:06:30.758574 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 19:06:30.758574 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application return self.creator() Aug 17 19:06:30.759690 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 19:06:30.759690 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application created_value = creator( Aug 17 19:06:30.759690 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 17 19:06:30.759690 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 17 19:06:30.759690 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 17 19:06:30.759690 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 17 19:06:30.759690 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 17 19:06:30.759690 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 17 19:06:30.759690 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Aug 17 19:06:30.759690 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application Aug 17 19:06:30.759690 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: [pid: 88551|app: 0|req: 268/555] 10.222.0.26 () {56 vars in 1099 bytes} [Wed Aug 17 19:06:30 2022] GET /identity/v3/users/glance => generated 84 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 19:06:30.759690 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8db43dec-4c37-4645-8a7e-a861dc94c1b8 None admin] Authenticating user token {{(pid=88551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:06:30.804497 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b759a4d-edd3-40d6-ae0b-ffe50d3e2def None admin] Validating token access rules against request {{(pid=88550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:06:30.839668 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dff9ead-9750-4609-afba-9527b3882374 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '819d41a279e64291acc60de51e1530ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:06:30.840289 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dff9ead-9750-4609-afba-9527b3882374 None admin] REQUEST_METHOD: `GET` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:06:30.840618 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dff9ead-9750-4609-afba-9527b3882374 None admin] SCRIPT_NAME: `/identity` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:06:30.840898 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dff9ead-9750-4609-afba-9527b3882374 None admin] PATH_INFO: `/v3/domains` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:06:30.841550 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dff9ead-9750-4609-afba-9527b3882374 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88550) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 19:06:30.842002 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dff9ead-9750-4609-afba-9527b3882374 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:06:30.843518 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dff9ead-9750-4609-afba-9527b3882374 None admin] RBAC: Authorization granted {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:06:30.854722 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: [pid: 88550|app: 0|req: 288/556] 10.222.0.26 () {56 vars in 1109 bytes} [Wed Aug 17 19:06:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 19:06:30.855576 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dff9ead-9750-4609-afba-9527b3882374 None admin] Authenticating user token {{(pid=88550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:06:30.860781 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8db43dec-4c37-4645-8a7e-a861dc94c1b8 None admin] Validating token access rules against request {{(pid=88551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:06:30.894391 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ce64ce9-35d0-40b2-a18e-ea6dc55e071f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '819d41a279e64291acc60de51e1530ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:06:30.895045 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce64ce9-35d0-40b2-a18e-ea6dc55e071f None admin] REQUEST_METHOD: `GET` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:06:30.895320 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce64ce9-35d0-40b2-a18e-ea6dc55e071f None admin] SCRIPT_NAME: `/identity` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:06:30.895591 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce64ce9-35d0-40b2-a18e-ea6dc55e071f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:06:30.902042 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG dbcounter [-] [88550] Writing DB stats keystone:SELECT=100 {{(pid=88550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:06:30.906026 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ce64ce9-35d0-40b2-a18e-ea6dc55e071f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:06:30.907558 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ce64ce9-35d0-40b2-a18e-ea6dc55e071f None admin] RBAC: Authorization granted {{(pid=88551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:06:30.921945 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application [None req-8ce64ce9-35d0-40b2-a18e-ea6dc55e071f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 19:06:30.921945 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 19:06:30.921945 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 19:06:30.921945 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 19:06:30.921945 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 19:06:30.921945 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 19:06:30.921945 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 19:06:30.921945 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 19:06:30.921945 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 19:06:30.921945 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 19:06:30.921945 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 19:06:30.921945 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 19:06:30.921945 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 17 19:06:30.921945 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 17 19:06:30.921945 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 17 19:06:30.921945 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 17 19:06:30.923294 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 19:06:30.923294 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 19:06:30.923294 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 19:06:30.923294 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 19:06:30.923294 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 19:06:30.923294 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 19:06:30.923294 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 19:06:30.923294 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application with Lock( Aug 17 19:06:30.923294 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 19:06:30.923294 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application return self._enter() Aug 17 19:06:30.923294 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 19:06:30.923294 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 19:06:30.923294 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 19:06:30.923294 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application return self.creator() Aug 17 19:06:30.923294 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 19:06:30.923294 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application created_value = creator( Aug 17 19:06:30.923294 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 17 19:06:30.924477 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 17 19:06:30.924477 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 19:06:30.924477 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application Aug 17 19:06:30.924477 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: [pid: 88551|app: 0|req: 269/557] 10.222.0.26 () {56 vars in 1108 bytes} [Wed Aug 17 19:06:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 19:06:30.924477 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ce64ce9-35d0-40b2-a18e-ea6dc55e071f None admin] Authenticating user token {{(pid=88551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:06:30.962167 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dff9ead-9750-4609-afba-9527b3882374 None admin] Validating token access rules against request {{(pid=88550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:06:30.966988 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG dbcounter [-] [88551] Writing DB stats keystone:SELECT=100 {{(pid=88551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:06:30.999661 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1721bf1-b1df-42d6-8c99-15bade2ec79d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '819d41a279e64291acc60de51e1530ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:06:31.000281 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1721bf1-b1df-42d6-8c99-15bade2ec79d None admin] REQUEST_METHOD: `GET` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:06:31.000560 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1721bf1-b1df-42d6-8c99-15bade2ec79d None admin] SCRIPT_NAME: `/identity` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:06:31.000832 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1721bf1-b1df-42d6-8c99-15bade2ec79d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:06:31.011203 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1721bf1-b1df-42d6-8c99-15bade2ec79d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:06:31.012679 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1721bf1-b1df-42d6-8c99-15bade2ec79d None admin] RBAC: Authorization granted {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:06:31.024205 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ce64ce9-35d0-40b2-a18e-ea6dc55e071f None admin] Validating token access rules against request {{(pid=88551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:06:31.026323 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application [None req-f1721bf1-b1df-42d6-8c99-15bade2ec79d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 19:06:31.026323 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 19:06:31.026323 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 19:06:31.026323 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 19:06:31.026323 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 19:06:31.026323 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 19:06:31.026323 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 19:06:31.026323 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 19:06:31.026323 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 19:06:31.026323 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 19:06:31.026323 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 19:06:31.026323 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 19:06:31.026323 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 17 19:06:31.026323 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 17 19:06:31.026323 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 17 19:06:31.026323 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 17 19:06:31.028072 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 19:06:31.028072 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 19:06:31.028072 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 19:06:31.028072 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 19:06:31.028072 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 19:06:31.028072 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 19:06:31.028072 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 19:06:31.028072 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application with Lock( Aug 17 19:06:31.028072 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 19:06:31.028072 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return self._enter() Aug 17 19:06:31.028072 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 19:06:31.028072 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 19:06:31.028072 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 19:06:31.028072 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return self.creator() Aug 17 19:06:31.028072 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 19:06:31.028072 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application created_value = creator( Aug 17 19:06:31.028072 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 17 19:06:31.029991 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 17 19:06:31.029991 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 19:06:31.029991 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application Aug 17 19:06:31.029991 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: [pid: 88550|app: 0|req: 289/558] 10.222.0.26 () {56 vars in 1108 bytes} [Wed Aug 17 19:06:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 19:06:31.029991 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1721bf1-b1df-42d6-8c99-15bade2ec79d None admin] Authenticating user token {{(pid=88550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:06:31.068644 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2500b61b-6553-4d68-bca8-02e7013a815d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '819d41a279e64291acc60de51e1530ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:06:31.069236 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2500b61b-6553-4d68-bca8-02e7013a815d None admin] REQUEST_METHOD: `GET` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:06:31.069515 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2500b61b-6553-4d68-bca8-02e7013a815d None admin] SCRIPT_NAME: `/identity` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:06:31.069791 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2500b61b-6553-4d68-bca8-02e7013a815d None admin] PATH_INFO: `/v3/users` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:06:31.070513 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2500b61b-6553-4d68-bca8-02e7013a815d None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=88551) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 19:06:31.070852 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2500b61b-6553-4d68-bca8-02e7013a815d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:06:31.072270 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2500b61b-6553-4d68-bca8-02e7013a815d None admin] RBAC: Authorization granted {{(pid=88551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:06:31.088983 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: [pid: 88551|app: 0|req: 270/559] 10.222.0.26 () {56 vars in 1137 bytes} [Wed Aug 17 19:06:30 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 19:06:31.089820 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2500b61b-6553-4d68-bca8-02e7013a815d None admin] Authenticating user token {{(pid=88551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:06:31.125508 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG dbcounter [-] [88550] Writing DB stats keystone:SELECT=100 {{(pid=88550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:06:31.129023 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1721bf1-b1df-42d6-8c99-15bade2ec79d None admin] Validating token access rules against request {{(pid=88550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:06:31.162420 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e1fb022-2544-4a07-a05d-f69c6668b122 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '819d41a279e64291acc60de51e1530ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:06:31.163064 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e1fb022-2544-4a07-a05d-f69c6668b122 None admin] REQUEST_METHOD: `GET` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:06:31.163346 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e1fb022-2544-4a07-a05d-f69c6668b122 None admin] SCRIPT_NAME: `/identity` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:06:31.163614 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e1fb022-2544-4a07-a05d-f69c6668b122 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:06:31.171436 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e1fb022-2544-4a07-a05d-f69c6668b122 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:06:31.172867 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e1fb022-2544-4a07-a05d-f69c6668b122 None admin] RBAC: Authorization granted {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:06:31.183799 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application [None req-3e1fb022-2544-4a07-a05d-f69c6668b122 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Aug 17 19:06:31.183799 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 19:06:31.183799 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 19:06:31.183799 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 19:06:31.183799 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 19:06:31.183799 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 19:06:31.183799 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 19:06:31.183799 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 19:06:31.183799 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 19:06:31.183799 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 19:06:31.183799 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 19:06:31.183799 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 19:06:31.183799 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 17 19:06:31.183799 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 17 19:06:31.183799 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 17 19:06:31.183799 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 17 19:06:31.184800 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 19:06:31.184800 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 19:06:31.184800 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 17 19:06:31.184800 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 17 19:06:31.184800 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 17 19:06:31.184800 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 17 19:06:31.184800 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 19:06:31.184800 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 19:06:31.184800 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 19:06:31.184800 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 19:06:31.184800 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 19:06:31.184800 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application with Lock( Aug 17 19:06:31.184800 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 19:06:31.184800 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return self._enter() Aug 17 19:06:31.184800 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 19:06:31.184800 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 19:06:31.184800 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 19:06:31.184800 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return self.creator() Aug 17 19:06:31.186050 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 19:06:31.186050 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application created_value = creator( Aug 17 19:06:31.186050 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 17 19:06:31.186050 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 17 19:06:31.186050 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 17 19:06:31.186050 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 17 19:06:31.186050 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 17 19:06:31.186050 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 17 19:06:31.186050 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Aug 17 19:06:31.186050 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application Aug 17 19:06:31.186050 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: [pid: 88550|app: 0|req: 290/560] 10.222.0.26 () {56 vars in 1099 bytes} [Wed Aug 17 19:06:31 2022] GET /identity/v3/users/cinder => generated 84 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 19:06:31.186050 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e1fb022-2544-4a07-a05d-f69c6668b122 None admin] Authenticating user token {{(pid=88550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:06:31.191962 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG dbcounter [-] [88551] Writing DB stats keystone:SELECT=100 {{(pid=88551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:06:31.194930 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2500b61b-6553-4d68-bca8-02e7013a815d None admin] Validating token access rules against request {{(pid=88551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:06:31.229083 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f5989a2-f271-449b-ad23-1f56810670ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '819d41a279e64291acc60de51e1530ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:06:31.229678 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f5989a2-f271-449b-ad23-1f56810670ce None admin] REQUEST_METHOD: `GET` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:06:31.229954 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f5989a2-f271-449b-ad23-1f56810670ce None admin] SCRIPT_NAME: `/identity` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:06:31.230226 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f5989a2-f271-449b-ad23-1f56810670ce None admin] PATH_INFO: `/v3/domains` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:06:31.230930 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f5989a2-f271-449b-ad23-1f56810670ce None admin] RBAC: Adding query filter params (name=Default) {{(pid=88551) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 19:06:31.231229 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f5989a2-f271-449b-ad23-1f56810670ce None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:06:31.233121 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f5989a2-f271-449b-ad23-1f56810670ce None admin] RBAC: Authorization granted {{(pid=88551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:06:31.244662 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: [pid: 88551|app: 0|req: 271/561] 10.222.0.26 () {56 vars in 1109 bytes} [Wed Aug 17 19:06:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 19:06:31.245456 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f5989a2-f271-449b-ad23-1f56810670ce None admin] Authenticating user token {{(pid=88551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:06:31.289634 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e1fb022-2544-4a07-a05d-f69c6668b122 None admin] Validating token access rules against request {{(pid=88550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:06:31.323947 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97a71682-fe2f-465b-a77e-13b57a32c41b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '819d41a279e64291acc60de51e1530ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:06:31.324575 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a71682-fe2f-465b-a77e-13b57a32c41b None admin] REQUEST_METHOD: `GET` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:06:31.324859 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a71682-fe2f-465b-a77e-13b57a32c41b None admin] SCRIPT_NAME: `/identity` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:06:31.325130 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a71682-fe2f-465b-a77e-13b57a32c41b None admin] PATH_INFO: `/v3/domains` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:06:31.325768 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97a71682-fe2f-465b-a77e-13b57a32c41b None admin] RBAC: Adding query filter params (name=Default) {{(pid=88550) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 19:06:31.326091 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97a71682-fe2f-465b-a77e-13b57a32c41b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:06:31.327485 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97a71682-fe2f-465b-a77e-13b57a32c41b None admin] RBAC: Authorization granted {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:06:31.339021 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: [pid: 88550|app: 0|req: 291/562] 10.222.0.26 () {56 vars in 1109 bytes} [Wed Aug 17 19:06:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 19:06:31.341094 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97a71682-fe2f-465b-a77e-13b57a32c41b None admin] Authenticating user token {{(pid=88550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:06:31.353520 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f5989a2-f271-449b-ad23-1f56810670ce None admin] Validating token access rules against request {{(pid=88551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:06:31.361570 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG dbcounter [-] [88550] Writing DB stats keystone:SELECT=100 {{(pid=88550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:06:31.389674 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfb9b72f-7ba5-42f0-8057-f02192c1344d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '819d41a279e64291acc60de51e1530ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:06:31.390295 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb9b72f-7ba5-42f0-8057-f02192c1344d None admin] REQUEST_METHOD: `GET` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:06:31.390592 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb9b72f-7ba5-42f0-8057-f02192c1344d None admin] SCRIPT_NAME: `/identity` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:06:31.390867 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb9b72f-7ba5-42f0-8057-f02192c1344d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:06:31.402121 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfb9b72f-7ba5-42f0-8057-f02192c1344d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:06:31.403597 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfb9b72f-7ba5-42f0-8057-f02192c1344d None admin] RBAC: Authorization granted {{(pid=88551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:06:31.419882 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application [None req-dfb9b72f-7ba5-42f0-8057-f02192c1344d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 19:06:31.419882 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 19:06:31.419882 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 19:06:31.419882 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 19:06:31.419882 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 19:06:31.419882 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 19:06:31.419882 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 19:06:31.419882 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 19:06:31.419882 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 19:06:31.419882 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 19:06:31.419882 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 19:06:31.419882 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 19:06:31.419882 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 17 19:06:31.419882 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 17 19:06:31.419882 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 17 19:06:31.419882 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 17 19:06:31.421069 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 19:06:31.421069 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 19:06:31.421069 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 19:06:31.421069 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 19:06:31.421069 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 19:06:31.421069 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 19:06:31.421069 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 19:06:31.421069 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application with Lock( Aug 17 19:06:31.421069 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 19:06:31.421069 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application return self._enter() Aug 17 19:06:31.421069 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 19:06:31.421069 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 19:06:31.421069 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 19:06:31.421069 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application return self.creator() Aug 17 19:06:31.421069 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 19:06:31.421069 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application created_value = creator( Aug 17 19:06:31.421069 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 17 19:06:31.422743 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 17 19:06:31.422743 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 19:06:31.422743 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application Aug 17 19:06:31.422743 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: [pid: 88551|app: 0|req: 272/563] 10.222.0.26 () {56 vars in 1108 bytes} [Wed Aug 17 19:06:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 19:06:31.426429 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfb9b72f-7ba5-42f0-8057-f02192c1344d None admin] Authenticating user token {{(pid=88551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:06:31.441330 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG dbcounter [-] [88551] Writing DB stats keystone:SELECT=100 {{(pid=88551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:06:31.448527 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97a71682-fe2f-465b-a77e-13b57a32c41b None admin] Validating token access rules against request {{(pid=88550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:06:31.483999 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d9c3c3f-5041-4beb-bba1-e43298d3a123 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '819d41a279e64291acc60de51e1530ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:06:31.484656 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d9c3c3f-5041-4beb-bba1-e43298d3a123 None admin] REQUEST_METHOD: `GET` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:06:31.484933 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d9c3c3f-5041-4beb-bba1-e43298d3a123 None admin] SCRIPT_NAME: `/identity` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:06:31.485204 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d9c3c3f-5041-4beb-bba1-e43298d3a123 None admin] PATH_INFO: `/v3/users` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:06:31.485930 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d9c3c3f-5041-4beb-bba1-e43298d3a123 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=88550) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 19:06:31.486232 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d9c3c3f-5041-4beb-bba1-e43298d3a123 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:06:31.487788 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d9c3c3f-5041-4beb-bba1-e43298d3a123 None admin] RBAC: Authorization granted {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:06:31.510567 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: [pid: 88550|app: 0|req: 292/564] 10.222.0.26 () {56 vars in 1137 bytes} [Wed Aug 17 19:06:31 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 19:06:31.510567 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d9c3c3f-5041-4beb-bba1-e43298d3a123 None admin] Authenticating user token {{(pid=88550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:06:31.534772 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfb9b72f-7ba5-42f0-8057-f02192c1344d None admin] Validating token access rules against request {{(pid=88551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:06:31.570868 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e0b04d9-07e3-4925-b791-1fc30903effc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '819d41a279e64291acc60de51e1530ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:06:31.571483 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e0b04d9-07e3-4925-b791-1fc30903effc None admin] REQUEST_METHOD: `GET` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:06:31.571755 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e0b04d9-07e3-4925-b791-1fc30903effc None admin] SCRIPT_NAME: `/identity` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:06:31.572026 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e0b04d9-07e3-4925-b791-1fc30903effc None admin] PATH_INFO: `/v3/users/neutron` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:06:31.579598 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e0b04d9-07e3-4925-b791-1fc30903effc None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=88551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:06:31.581036 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e0b04d9-07e3-4925-b791-1fc30903effc None admin] RBAC: Authorization granted {{(pid=88551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:06:31.585773 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG dbcounter [-] [88550] Writing DB stats keystone:SELECT=100 {{(pid=88550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:06:31.596160 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application [None req-0e0b04d9-07e3-4925-b791-1fc30903effc None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Aug 17 19:06:31.596160 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 19:06:31.596160 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 19:06:31.596160 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 19:06:31.596160 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 19:06:31.596160 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 19:06:31.596160 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 19:06:31.596160 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 19:06:31.596160 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 19:06:31.596160 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 19:06:31.596160 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 19:06:31.596160 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 19:06:31.596160 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 17 19:06:31.596160 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 17 19:06:31.596160 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 17 19:06:31.596160 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 17 19:06:31.597200 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 19:06:31.597200 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 19:06:31.597200 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 17 19:06:31.597200 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 17 19:06:31.597200 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 17 19:06:31.597200 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 17 19:06:31.597200 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 19:06:31.597200 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 19:06:31.597200 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 19:06:31.597200 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 19:06:31.597200 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 19:06:31.597200 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application with Lock( Aug 17 19:06:31.597200 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 19:06:31.597200 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application return self._enter() Aug 17 19:06:31.597200 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 19:06:31.597200 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 19:06:31.597200 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 19:06:31.597200 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application return self.creator() Aug 17 19:06:31.598213 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 19:06:31.598213 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application created_value = creator( Aug 17 19:06:31.598213 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 17 19:06:31.598213 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 17 19:06:31.598213 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 17 19:06:31.598213 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 17 19:06:31.598213 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 17 19:06:31.598213 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 17 19:06:31.598213 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Aug 17 19:06:31.598213 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application Aug 17 19:06:31.598213 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: [pid: 88551|app: 0|req: 273/565] 10.222.0.26 () {56 vars in 1102 bytes} [Wed Aug 17 19:06:31 2022] GET /identity/v3/users/neutron => generated 85 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 19:06:31.598213 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e0b04d9-07e3-4925-b791-1fc30903effc None admin] Authenticating user token {{(pid=88551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:06:31.614190 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d9c3c3f-5041-4beb-bba1-e43298d3a123 None admin] Validating token access rules against request {{(pid=88550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:06:31.648307 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ee7d5d1-692d-4b8f-92dc-46c540d8bbec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '819d41a279e64291acc60de51e1530ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:06:31.648899 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee7d5d1-692d-4b8f-92dc-46c540d8bbec None admin] REQUEST_METHOD: `GET` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:06:31.649173 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee7d5d1-692d-4b8f-92dc-46c540d8bbec None admin] SCRIPT_NAME: `/identity` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:06:31.649442 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee7d5d1-692d-4b8f-92dc-46c540d8bbec None admin] PATH_INFO: `/v3/projects/service` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:06:31.656153 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ee7d5d1-692d-4b8f-92dc-46c540d8bbec None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:06:31.657603 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ee7d5d1-692d-4b8f-92dc-46c540d8bbec None admin] RBAC: Authorization granted {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:06:31.666207 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG dbcounter [-] [88551] Writing DB stats keystone:SELECT=100 {{(pid=88551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:06:31.668414 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application [None req-2ee7d5d1-692d-4b8f-92dc-46c540d8bbec None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 17 19:06:31.668414 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 19:06:31.668414 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 19:06:31.668414 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 19:06:31.668414 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 19:06:31.668414 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 19:06:31.668414 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 19:06:31.668414 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 19:06:31.668414 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 19:06:31.668414 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 19:06:31.668414 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 19:06:31.668414 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 19:06:31.668414 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 17 19:06:31.668414 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 17 19:06:31.668414 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 17 19:06:31.669481 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 17 19:06:31.669481 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 19:06:31.669481 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 19:06:31.669481 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 19:06:31.669481 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 19:06:31.669481 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 19:06:31.669481 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 19:06:31.669481 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 19:06:31.669481 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application with Lock( Aug 17 19:06:31.669481 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 19:06:31.669481 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return self._enter() Aug 17 19:06:31.669481 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 19:06:31.669481 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 19:06:31.669481 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 19:06:31.669481 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return self.creator() Aug 17 19:06:31.669481 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 19:06:31.669481 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application created_value = creator( Aug 17 19:06:31.670952 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 17 19:06:31.670952 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 17 19:06:31.670952 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 17 19:06:31.670952 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 17 19:06:31.670952 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 17 19:06:31.670952 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 17 19:06:31.670952 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 17 19:06:31.670952 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application Aug 17 19:06:31.670952 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: [pid: 88550|app: 0|req: 293/566] 10.222.0.26 () {56 vars in 1111 bytes} [Wed Aug 17 19:06:31 2022] GET /identity/v3/projects/service => generated 88 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 19:06:31.671443 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ee7d5d1-692d-4b8f-92dc-46c540d8bbec None admin] Authenticating user token {{(pid=88550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:06:31.697612 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e0b04d9-07e3-4925-b791-1fc30903effc None admin] Validating token access rules against request {{(pid=88551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:06:31.730399 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b07a4e07-6681-4933-a15f-bbf42142bcd9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '819d41a279e64291acc60de51e1530ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:06:31.731042 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b07a4e07-6681-4933-a15f-bbf42142bcd9 None admin] REQUEST_METHOD: `GET` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:06:31.731279 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b07a4e07-6681-4933-a15f-bbf42142bcd9 None admin] SCRIPT_NAME: `/identity` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:06:31.731548 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b07a4e07-6681-4933-a15f-bbf42142bcd9 None admin] PATH_INFO: `/v3/domains` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:06:31.732187 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b07a4e07-6681-4933-a15f-bbf42142bcd9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88551) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 19:06:31.733015 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b07a4e07-6681-4933-a15f-bbf42142bcd9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:06:31.734370 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b07a4e07-6681-4933-a15f-bbf42142bcd9 None admin] RBAC: Authorization granted {{(pid=88551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:06:31.745740 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: [pid: 88551|app: 0|req: 274/567] 10.222.0.26 () {56 vars in 1109 bytes} [Wed Aug 17 19:06:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 19:06:31.746499 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b07a4e07-6681-4933-a15f-bbf42142bcd9 None admin] Authenticating user token {{(pid=88551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:06:31.773587 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ee7d5d1-692d-4b8f-92dc-46c540d8bbec None admin] Validating token access rules against request {{(pid=88550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:06:31.807609 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bfd5f7d-0669-42c1-be68-0cc6c3bcc03b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '819d41a279e64291acc60de51e1530ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:06:31.808233 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bfd5f7d-0669-42c1-be68-0cc6c3bcc03b None admin] REQUEST_METHOD: `GET` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:06:31.808515 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bfd5f7d-0669-42c1-be68-0cc6c3bcc03b None admin] SCRIPT_NAME: `/identity` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:06:31.808789 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bfd5f7d-0669-42c1-be68-0cc6c3bcc03b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:06:31.811657 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG dbcounter [-] [88550] Writing DB stats keystone:SELECT=100 {{(pid=88550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:06:31.819314 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bfd5f7d-0669-42c1-be68-0cc6c3bcc03b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:06:31.820782 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bfd5f7d-0669-42c1-be68-0cc6c3bcc03b None admin] RBAC: Authorization granted {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:06:31.835453 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application [None req-9bfd5f7d-0669-42c1-be68-0cc6c3bcc03b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 19:06:31.835453 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 19:06:31.835453 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 19:06:31.835453 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 19:06:31.835453 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 19:06:31.835453 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 19:06:31.835453 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 19:06:31.835453 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 19:06:31.835453 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 19:06:31.835453 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 19:06:31.835453 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 19:06:31.835453 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 19:06:31.835453 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 17 19:06:31.835453 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 17 19:06:31.835453 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 17 19:06:31.835453 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 17 19:06:31.836601 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 19:06:31.836601 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 19:06:31.836601 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 19:06:31.836601 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 19:06:31.836601 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 19:06:31.836601 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 19:06:31.836601 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 19:06:31.836601 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application with Lock( Aug 17 19:06:31.836601 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 19:06:31.836601 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return self._enter() Aug 17 19:06:31.836601 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 19:06:31.836601 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 19:06:31.836601 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 19:06:31.836601 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return self.creator() Aug 17 19:06:31.836601 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 19:06:31.836601 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application created_value = creator( Aug 17 19:06:31.836601 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 17 19:06:31.837675 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 17 19:06:31.837675 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 19:06:31.837675 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application Aug 17 19:06:31.837675 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: [pid: 88550|app: 0|req: 294/568] 10.222.0.26 () {56 vars in 1108 bytes} [Wed Aug 17 19:06:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 19:06:31.837675 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bfd5f7d-0669-42c1-be68-0cc6c3bcc03b None admin] Authenticating user token {{(pid=88550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:06:31.851019 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b07a4e07-6681-4933-a15f-bbf42142bcd9 None admin] Validating token access rules against request {{(pid=88551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:06:31.879337 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG dbcounter [-] [88551] Writing DB stats keystone:SELECT=100 {{(pid=88551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:06:31.884050 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dce09110-b396-4de5-8dbc-77987985b112 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '819d41a279e64291acc60de51e1530ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:06:31.888134 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce09110-b396-4de5-8dbc-77987985b112 None admin] REQUEST_METHOD: `GET` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:06:31.888134 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce09110-b396-4de5-8dbc-77987985b112 None admin] SCRIPT_NAME: `/identity` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:06:31.888134 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce09110-b396-4de5-8dbc-77987985b112 None admin] PATH_INFO: `/v3/users` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:06:31.888134 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dce09110-b396-4de5-8dbc-77987985b112 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=88551) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 19:06:31.888134 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dce09110-b396-4de5-8dbc-77987985b112 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:06:31.888134 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dce09110-b396-4de5-8dbc-77987985b112 None admin] RBAC: Authorization granted {{(pid=88551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:06:31.905497 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: [pid: 88551|app: 0|req: 275/569] 10.222.0.26 () {56 vars in 1139 bytes} [Wed Aug 17 19:06:31 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 19:06:31.906280 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dce09110-b396-4de5-8dbc-77987985b112 None admin] Authenticating user token {{(pid=88551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:06:31.939795 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bfd5f7d-0669-42c1-be68-0cc6c3bcc03b None admin] Validating token access rules against request {{(pid=88550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:06:31.979721 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-821b8eba-28d7-42a4-98da-f07dbe8ce02e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '819d41a279e64291acc60de51e1530ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:06:31.980338 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-821b8eba-28d7-42a4-98da-f07dbe8ce02e None admin] REQUEST_METHOD: `GET` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:06:31.980704 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-821b8eba-28d7-42a4-98da-f07dbe8ce02e None admin] SCRIPT_NAME: `/identity` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:06:31.981022 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-821b8eba-28d7-42a4-98da-f07dbe8ce02e None admin] PATH_INFO: `/v3/projects` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:06:31.981975 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-821b8eba-28d7-42a4-98da-f07dbe8ce02e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88550) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 19:06:31.982298 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-821b8eba-28d7-42a4-98da-f07dbe8ce02e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:06:31.984573 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-821b8eba-28d7-42a4-98da-f07dbe8ce02e None admin] RBAC: Authorization granted {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:06:31.997064 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: [pid: 88550|app: 0|req: 295/570] 10.222.0.26 () {56 vars in 1148 bytes} [Wed Aug 17 19:06:31 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 19:06:31.997938 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-821b8eba-28d7-42a4-98da-f07dbe8ce02e None admin] Authenticating user token {{(pid=88550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:06:32.022358 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dce09110-b396-4de5-8dbc-77987985b112 None admin] Validating token access rules against request {{(pid=88551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:06:32.047507 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG dbcounter [-] [88550] Writing DB stats keystone:SELECT=100 {{(pid=88550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:06:32.063731 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dcbc56d-4c67-443b-a316-a994679af8a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '819d41a279e64291acc60de51e1530ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:06:32.064346 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dcbc56d-4c67-443b-a316-a994679af8a2 None admin] REQUEST_METHOD: `GET` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:06:32.064623 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dcbc56d-4c67-443b-a316-a994679af8a2 None admin] SCRIPT_NAME: `/identity` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:06:32.064956 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dcbc56d-4c67-443b-a316-a994679af8a2 None admin] PATH_INFO: `/v3/projects/service` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:06:32.071794 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dcbc56d-4c67-443b-a316-a994679af8a2 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:06:32.073208 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dcbc56d-4c67-443b-a316-a994679af8a2 None admin] RBAC: Authorization granted {{(pid=88551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:06:32.084156 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application [None req-0dcbc56d-4c67-443b-a316-a994679af8a2 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 17 19:06:32.084156 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 19:06:32.084156 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 19:06:32.084156 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 19:06:32.084156 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 19:06:32.084156 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 19:06:32.084156 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 19:06:32.084156 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 19:06:32.084156 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 19:06:32.084156 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 19:06:32.084156 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 19:06:32.084156 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 19:06:32.084156 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 17 19:06:32.084156 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 17 19:06:32.084156 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 17 19:06:32.085304 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 17 19:06:32.085304 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 19:06:32.085304 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 19:06:32.085304 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 19:06:32.085304 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 19:06:32.085304 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 19:06:32.085304 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 19:06:32.085304 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 19:06:32.085304 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application with Lock( Aug 17 19:06:32.085304 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 19:06:32.085304 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application return self._enter() Aug 17 19:06:32.085304 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 19:06:32.085304 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 19:06:32.085304 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 19:06:32.085304 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application return self.creator() Aug 17 19:06:32.085304 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 19:06:32.085304 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application created_value = creator( Aug 17 19:06:32.086755 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 17 19:06:32.086755 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 17 19:06:32.086755 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 17 19:06:32.086755 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 17 19:06:32.086755 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 17 19:06:32.086755 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 17 19:06:32.086755 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 17 19:06:32.086755 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application Aug 17 19:06:32.086755 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: [pid: 88551|app: 0|req: 276/571] 10.222.0.26 () {56 vars in 1111 bytes} [Wed Aug 17 19:06:31 2022] GET /identity/v3/projects/service => generated 88 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 19:06:32.086755 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dcbc56d-4c67-443b-a316-a994679af8a2 None admin] Authenticating user token {{(pid=88551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:06:32.101490 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-821b8eba-28d7-42a4-98da-f07dbe8ce02e None admin] Validating token access rules against request {{(pid=88550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:06:32.134269 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG dbcounter [-] [88551] Writing DB stats keystone:SELECT=100 {{(pid=88551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:06:32.136385 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81526ae1-768d-431f-b5b7-5aeedcb1ca53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '819d41a279e64291acc60de51e1530ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:06:32.137071 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81526ae1-768d-431f-b5b7-5aeedcb1ca53 None admin] REQUEST_METHOD: `GET` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:06:32.137417 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81526ae1-768d-431f-b5b7-5aeedcb1ca53 None admin] SCRIPT_NAME: `/identity` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:06:32.137693 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81526ae1-768d-431f-b5b7-5aeedcb1ca53 None admin] PATH_INFO: `/v3/domains` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:06:32.139334 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81526ae1-768d-431f-b5b7-5aeedcb1ca53 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88550) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 19:06:32.139640 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81526ae1-768d-431f-b5b7-5aeedcb1ca53 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:06:32.141012 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81526ae1-768d-431f-b5b7-5aeedcb1ca53 None admin] RBAC: Authorization granted {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:06:32.152645 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: [pid: 88550|app: 0|req: 296/572] 10.222.0.26 () {56 vars in 1109 bytes} [Wed Aug 17 19:06:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 19:06:32.157871 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81526ae1-768d-431f-b5b7-5aeedcb1ca53 None admin] Authenticating user token {{(pid=88550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:06:32.196086 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dcbc56d-4c67-443b-a316-a994679af8a2 None admin] Validating token access rules against request {{(pid=88551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:06:32.228837 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b150de00-3833-4a68-828a-3f7d89864b1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '819d41a279e64291acc60de51e1530ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:06:32.229443 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b150de00-3833-4a68-828a-3f7d89864b1e None admin] REQUEST_METHOD: `GET` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:06:32.229717 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b150de00-3833-4a68-828a-3f7d89864b1e None admin] SCRIPT_NAME: `/identity` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:06:32.229986 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b150de00-3833-4a68-828a-3f7d89864b1e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:06:32.240477 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b150de00-3833-4a68-828a-3f7d89864b1e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:06:32.241899 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b150de00-3833-4a68-828a-3f7d89864b1e None admin] RBAC: Authorization granted {{(pid=88551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:06:32.255005 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81526ae1-768d-431f-b5b7-5aeedcb1ca53 None admin] Validating token access rules against request {{(pid=88550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:06:32.255713 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application [None req-b150de00-3833-4a68-828a-3f7d89864b1e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 19:06:32.255713 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 19:06:32.255713 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 19:06:32.255713 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 19:06:32.255713 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 19:06:32.255713 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 19:06:32.255713 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 19:06:32.255713 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 19:06:32.255713 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 19:06:32.255713 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 19:06:32.255713 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 19:06:32.255713 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 19:06:32.255713 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 17 19:06:32.255713 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 17 19:06:32.255713 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 17 19:06:32.255713 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 17 19:06:32.256840 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 19:06:32.256840 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 19:06:32.256840 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 19:06:32.256840 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 19:06:32.256840 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 19:06:32.256840 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 19:06:32.256840 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 19:06:32.256840 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application with Lock( Aug 17 19:06:32.256840 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 19:06:32.256840 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application return self._enter() Aug 17 19:06:32.256840 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 19:06:32.256840 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 19:06:32.256840 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 19:06:32.256840 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application return self.creator() Aug 17 19:06:32.256840 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 19:06:32.256840 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application created_value = creator( Aug 17 19:06:32.256840 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 17 19:06:32.257946 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 17 19:06:32.257946 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 19:06:32.257946 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application Aug 17 19:06:32.257946 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: [pid: 88551|app: 0|req: 277/573] 10.222.0.26 () {56 vars in 1108 bytes} [Wed Aug 17 19:06:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 19:06:32.257946 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b150de00-3833-4a68-828a-3f7d89864b1e None admin] Authenticating user token {{(pid=88551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:06:32.266964 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG dbcounter [-] [88550] Writing DB stats keystone:SELECT=100 {{(pid=88550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:06:32.291510 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-375d1543-637f-4100-99c5-6d9410840464 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '819d41a279e64291acc60de51e1530ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:06:32.292164 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-375d1543-637f-4100-99c5-6d9410840464 None admin] REQUEST_METHOD: `PUT` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:06:32.292446 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-375d1543-637f-4100-99c5-6d9410840464 None admin] SCRIPT_NAME: `/identity` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:06:32.292727 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-375d1543-637f-4100-99c5-6d9410840464 None admin] PATH_INFO: `/v3/projects/4bbf6c5abd684d899d09a08b0847d81c/users/9ae23e7a10d54989a25c9f3019184d01/roles/c798e3cf305b42dc8579aac6f3229a4b` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:06:32.308545 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-375d1543-637f-4100-99c5-6d9410840464 None admin] RBAC: Authorizing `identity:create_grant(project_id=4bbf6c5abd684d899d09a08b0847d81c, user_id=9ae23e7a10d54989a25c9f3019184d01, role_id=c798e3cf305b42dc8579aac6f3229a4b)` {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:06:32.310004 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-375d1543-637f-4100-99c5-6d9410840464 None admin] RBAC: Authorization granted {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:06:32.356023 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b150de00-3833-4a68-828a-3f7d89864b1e None admin] Validating token access rules against request {{(pid=88551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:06:32.357425 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG dbcounter [-] [88551] Writing DB stats keystone:SELECT=100 {{(pid=88551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:06:32.383440 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: [pid: 88550|app: 0|req: 297/574] 10.222.0.26 () {58 vars in 1439 bytes} [Wed Aug 17 19:06:32 2022] PUT /identity/v3/projects/4bbf6c5abd684d899d09a08b0847d81c/users/9ae23e7a10d54989a25c9f3019184d01/roles/c798e3cf305b42dc8579aac6f3229a4b => generated 0 bytes in 230 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 19:06:32.384300 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-375d1543-637f-4100-99c5-6d9410840464 None admin] Authenticating user token {{(pid=88550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:06:32.389284 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7290081-d9bd-4d8b-9881-16a4940ae5d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '819d41a279e64291acc60de51e1530ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:06:32.389912 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7290081-d9bd-4d8b-9881-16a4940ae5d4 None admin] REQUEST_METHOD: `GET` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:06:32.390228 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7290081-d9bd-4d8b-9881-16a4940ae5d4 None admin] SCRIPT_NAME: `/identity` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:06:32.390454 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7290081-d9bd-4d8b-9881-16a4940ae5d4 None admin] PATH_INFO: `/v3/projects` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:06:32.391189 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7290081-d9bd-4d8b-9881-16a4940ae5d4 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88551) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 19:06:32.391497 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7290081-d9bd-4d8b-9881-16a4940ae5d4 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:06:32.393022 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7290081-d9bd-4d8b-9881-16a4940ae5d4 None admin] RBAC: Authorization granted {{(pid=88551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:06:32.408194 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: [pid: 88551|app: 0|req: 278/575] 10.222.0.26 () {56 vars in 1148 bytes} [Wed Aug 17 19:06:32 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 19:06:32.409474 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7290081-d9bd-4d8b-9881-16a4940ae5d4 None admin] Authenticating user token {{(pid=88551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:06:32.521000 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-375d1543-637f-4100-99c5-6d9410840464 None admin] Validating token access rules against request {{(pid=88550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:06:32.536676 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7290081-d9bd-4d8b-9881-16a4940ae5d4 None admin] Validating token access rules against request {{(pid=88551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:06:32.566827 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7202caf3-b3ca-4787-8aa7-0c2b87dd45af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '819d41a279e64291acc60de51e1530ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:06:32.566827 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7202caf3-b3ca-4787-8aa7-0c2b87dd45af None admin] REQUEST_METHOD: `GET` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:06:32.567142 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7202caf3-b3ca-4787-8aa7-0c2b87dd45af None admin] SCRIPT_NAME: `/identity` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:06:32.567236 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7202caf3-b3ca-4787-8aa7-0c2b87dd45af None admin] PATH_INFO: `/v3/projects/service` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:06:32.574714 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7202caf3-b3ca-4787-8aa7-0c2b87dd45af None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:06:32.578295 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7202caf3-b3ca-4787-8aa7-0c2b87dd45af None admin] RBAC: Authorization granted {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:06:32.582426 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eb3a8cc-ceee-4a5f-8ecc-c8d49181544d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '819d41a279e64291acc60de51e1530ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:06:32.583197 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb3a8cc-ceee-4a5f-8ecc-c8d49181544d None admin] REQUEST_METHOD: `GET` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:06:32.583580 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb3a8cc-ceee-4a5f-8ecc-c8d49181544d None admin] SCRIPT_NAME: `/identity` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:06:32.583928 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb3a8cc-ceee-4a5f-8ecc-c8d49181544d None admin] PATH_INFO: `/v3/domains` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:06:32.584639 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eb3a8cc-ceee-4a5f-8ecc-c8d49181544d None admin] RBAC: Adding query filter params (name=Default) {{(pid=88551) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 19:06:32.585011 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eb3a8cc-ceee-4a5f-8ecc-c8d49181544d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:06:32.586428 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eb3a8cc-ceee-4a5f-8ecc-c8d49181544d None admin] RBAC: Authorization granted {{(pid=88551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:06:32.588415 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application [None req-7202caf3-b3ca-4787-8aa7-0c2b87dd45af None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 17 19:06:32.588415 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 19:06:32.588415 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 19:06:32.588415 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 19:06:32.588415 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 19:06:32.588415 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 19:06:32.588415 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 19:06:32.588415 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 19:06:32.588415 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 19:06:32.588415 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 19:06:32.588415 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 19:06:32.588415 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 19:06:32.588415 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 17 19:06:32.588415 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 17 19:06:32.588415 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 17 19:06:32.589460 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 17 19:06:32.589460 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 19:06:32.589460 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 19:06:32.589460 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 19:06:32.589460 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 19:06:32.589460 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 19:06:32.589460 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 19:06:32.589460 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 19:06:32.589460 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application with Lock( Aug 17 19:06:32.589460 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 19:06:32.589460 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return self._enter() Aug 17 19:06:32.589460 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 19:06:32.589460 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 19:06:32.589460 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 19:06:32.589460 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return self.creator() Aug 17 19:06:32.589460 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 19:06:32.589460 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application created_value = creator( Aug 17 19:06:32.590775 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 17 19:06:32.590775 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 17 19:06:32.590775 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 17 19:06:32.590775 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 17 19:06:32.590775 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 17 19:06:32.590775 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 17 19:06:32.590775 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 17 19:06:32.590775 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application Aug 17 19:06:32.590775 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: [pid: 88550|app: 0|req: 298/576] 10.222.0.26 () {56 vars in 1111 bytes} [Wed Aug 17 19:06:32 2022] GET /identity/v3/projects/service => generated 88 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 19:06:32.590775 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7202caf3-b3ca-4787-8aa7-0c2b87dd45af None admin] Authenticating user token {{(pid=88550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:06:32.600778 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: [pid: 88551|app: 0|req: 279/577] 10.222.0.26 () {56 vars in 1109 bytes} [Wed Aug 17 19:06:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 19:06:32.601617 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eb3a8cc-ceee-4a5f-8ecc-c8d49181544d None admin] Authenticating user token {{(pid=88551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:06:32.614823 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG dbcounter [-] [88550] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:06:32.626613 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG dbcounter [-] [88551] Writing DB stats keystone:SELECT=100 {{(pid=88551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:06:32.709532 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7202caf3-b3ca-4787-8aa7-0c2b87dd45af None admin] Validating token access rules against request {{(pid=88550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:06:32.710803 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eb3a8cc-ceee-4a5f-8ecc-c8d49181544d None admin] Validating token access rules against request {{(pid=88551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:06:32.744799 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-069aaa56-2fe2-43e5-9da0-92d86406f3b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '819d41a279e64291acc60de51e1530ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:06:32.745565 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-069aaa56-2fe2-43e5-9da0-92d86406f3b9 None admin] REQUEST_METHOD: `PUT` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:06:32.745909 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-069aaa56-2fe2-43e5-9da0-92d86406f3b9 None admin] SCRIPT_NAME: `/identity` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:06:32.746253 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-069aaa56-2fe2-43e5-9da0-92d86406f3b9 None admin] PATH_INFO: `/v3/projects/4bbf6c5abd684d899d09a08b0847d81c/users/5f32f6111c1c4f1f86c2185bde99a368/roles/c798e3cf305b42dc8579aac6f3229a4b` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:06:32.750624 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d04e97c3-c694-43de-ac73-dfb6a67a8cce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '819d41a279e64291acc60de51e1530ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:06:32.751220 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d04e97c3-c694-43de-ac73-dfb6a67a8cce None admin] REQUEST_METHOD: `GET` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:06:32.751495 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d04e97c3-c694-43de-ac73-dfb6a67a8cce None admin] SCRIPT_NAME: `/identity` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:06:32.751763 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d04e97c3-c694-43de-ac73-dfb6a67a8cce None admin] PATH_INFO: `/v3/projects` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:06:32.752453 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d04e97c3-c694-43de-ac73-dfb6a67a8cce None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88551) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 19:06:32.752753 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d04e97c3-c694-43de-ac73-dfb6a67a8cce None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:06:32.754163 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d04e97c3-c694-43de-ac73-dfb6a67a8cce None admin] RBAC: Authorization granted {{(pid=88551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:06:32.762969 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-069aaa56-2fe2-43e5-9da0-92d86406f3b9 None admin] RBAC: Authorizing `identity:create_grant(project_id=4bbf6c5abd684d899d09a08b0847d81c, user_id=5f32f6111c1c4f1f86c2185bde99a368, role_id=c798e3cf305b42dc8579aac6f3229a4b)` {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:06:32.764992 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-069aaa56-2fe2-43e5-9da0-92d86406f3b9 None admin] RBAC: Authorization granted {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:06:32.767193 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: [pid: 88551|app: 0|req: 280/578] 10.222.0.26 () {56 vars in 1148 bytes} [Wed Aug 17 19:06:32 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 19:06:32.768117 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d04e97c3-c694-43de-ac73-dfb6a67a8cce None admin] Authenticating user token {{(pid=88551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:06:32.830567 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: [pid: 88550|app: 0|req: 299/579] 10.222.0.26 () {58 vars in 1439 bytes} [Wed Aug 17 19:06:32 2022] PUT /identity/v3/projects/4bbf6c5abd684d899d09a08b0847d81c/users/5f32f6111c1c4f1f86c2185bde99a368/roles/c798e3cf305b42dc8579aac6f3229a4b => generated 0 bytes in 233 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 19:06:32.830567 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-069aaa56-2fe2-43e5-9da0-92d86406f3b9 None admin] Authenticating user token {{(pid=88550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:06:32.867129 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG dbcounter [-] [88551] Writing DB stats keystone:SELECT=100 {{(pid=88551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:06:32.884465 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d04e97c3-c694-43de-ac73-dfb6a67a8cce None admin] Validating token access rules against request {{(pid=88551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:06:32.931101 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8a20131-69e2-4171-aabf-591cd9d1ced9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '819d41a279e64291acc60de51e1530ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:06:32.931101 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a20131-69e2-4171-aabf-591cd9d1ced9 None admin] REQUEST_METHOD: `GET` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:06:32.931101 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a20131-69e2-4171-aabf-591cd9d1ced9 None admin] SCRIPT_NAME: `/identity` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:06:32.931101 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a20131-69e2-4171-aabf-591cd9d1ced9 None admin] PATH_INFO: `/v3/projects/service` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:06:32.939543 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG dbcounter [-] [88550] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:06:32.946851 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8a20131-69e2-4171-aabf-591cd9d1ced9 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:06:32.948343 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8a20131-69e2-4171-aabf-591cd9d1ced9 None admin] RBAC: Authorization granted {{(pid=88551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:06:32.969595 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application [None req-e8a20131-69e2-4171-aabf-591cd9d1ced9 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 17 19:06:32.969595 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 19:06:32.969595 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 19:06:32.969595 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 19:06:32.969595 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 19:06:32.969595 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 19:06:32.969595 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 19:06:32.969595 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 19:06:32.969595 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 19:06:32.969595 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 19:06:32.969595 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 19:06:32.969595 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 19:06:32.969595 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 17 19:06:32.969595 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 17 19:06:32.969595 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 17 19:06:32.970759 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 17 19:06:32.970759 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 19:06:32.970759 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 19:06:32.970759 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 19:06:32.970759 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 19:06:32.970759 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 19:06:32.970759 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 19:06:32.970759 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 19:06:32.970759 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application with Lock( Aug 17 19:06:32.970759 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 19:06:32.970759 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application return self._enter() Aug 17 19:06:32.970759 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 19:06:32.970759 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 19:06:32.970759 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 19:06:32.970759 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application return self.creator() Aug 17 19:06:32.970759 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 19:06:32.970759 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application created_value = creator( Aug 17 19:06:32.971754 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 17 19:06:32.971754 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 17 19:06:32.971754 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 17 19:06:32.971754 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 17 19:06:32.971754 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 17 19:06:32.971754 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 17 19:06:32.971754 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 17 19:06:32.971754 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application Aug 17 19:06:32.972237 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: [pid: 88551|app: 0|req: 281/580] 10.222.0.26 () {56 vars in 1111 bytes} [Wed Aug 17 19:06:32 2022] GET /identity/v3/projects/service => generated 88 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 19:06:32.979693 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8a20131-69e2-4171-aabf-591cd9d1ced9 None admin] Authenticating user token {{(pid=88551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:06:32.997673 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-069aaa56-2fe2-43e5-9da0-92d86406f3b9 None admin] Validating token access rules against request {{(pid=88550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:06:33.054902 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d41df288-56e6-408d-bfa9-1ddab3a96ae7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '819d41a279e64291acc60de51e1530ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:06:33.055356 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d41df288-56e6-408d-bfa9-1ddab3a96ae7 None admin] REQUEST_METHOD: `PUT` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:06:33.056253 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d41df288-56e6-408d-bfa9-1ddab3a96ae7 None admin] SCRIPT_NAME: `/identity` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:06:33.056253 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d41df288-56e6-408d-bfa9-1ddab3a96ae7 None admin] PATH_INFO: `/v3/projects/4bbf6c5abd684d899d09a08b0847d81c/users/0a7ec0aa480147f897f8a76b5b29f3c4/roles/c798e3cf305b42dc8579aac6f3229a4b` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:06:33.085043 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d41df288-56e6-408d-bfa9-1ddab3a96ae7 None admin] RBAC: Authorizing `identity:create_grant(project_id=4bbf6c5abd684d899d09a08b0847d81c, user_id=0a7ec0aa480147f897f8a76b5b29f3c4, role_id=c798e3cf305b42dc8579aac6f3229a4b)` {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:06:33.086522 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d41df288-56e6-408d-bfa9-1ddab3a96ae7 None admin] RBAC: Authorization granted {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:06:33.110785 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8a20131-69e2-4171-aabf-591cd9d1ced9 None admin] Validating token access rules against request {{(pid=88551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:06:33.148748 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6959be8-b0c8-4a9f-b3d3-f9afae4b2d1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '819d41a279e64291acc60de51e1530ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:06:33.149362 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6959be8-b0c8-4a9f-b3d3-f9afae4b2d1f None admin] REQUEST_METHOD: `GET` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:06:33.149717 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6959be8-b0c8-4a9f-b3d3-f9afae4b2d1f None admin] SCRIPT_NAME: `/identity` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:06:33.150056 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6959be8-b0c8-4a9f-b3d3-f9afae4b2d1f None admin] PATH_INFO: `/v3/projects` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:06:33.150951 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6959be8-b0c8-4a9f-b3d3-f9afae4b2d1f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88551) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 19:06:33.151315 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6959be8-b0c8-4a9f-b3d3-f9afae4b2d1f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:06:33.153013 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6959be8-b0c8-4a9f-b3d3-f9afae4b2d1f None admin] RBAC: Authorization granted {{(pid=88551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:06:33.165483 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: [pid: 88551|app: 0|req: 282/581] 10.222.0.26 () {56 vars in 1148 bytes} [Wed Aug 17 19:06:32 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 19:06:33.171813 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6959be8-b0c8-4a9f-b3d3-f9afae4b2d1f None admin] Authenticating user token {{(pid=88551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:06:33.174660 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG dbcounter [-] [88551] Writing DB stats keystone:SELECT=100 {{(pid=88551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:06:33.207737 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: [pid: 88550|app: 0|req: 300/582] 10.222.0.26 () {58 vars in 1439 bytes} [Wed Aug 17 19:06:32 2022] PUT /identity/v3/projects/4bbf6c5abd684d899d09a08b0847d81c/users/0a7ec0aa480147f897f8a76b5b29f3c4/roles/c798e3cf305b42dc8579aac6f3229a4b => generated 0 bytes in 384 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 19:06:33.297002 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6959be8-b0c8-4a9f-b3d3-f9afae4b2d1f None admin] Validating token access rules against request {{(pid=88551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:06:33.337284 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c5dbb1d-ccd6-4a67-8ea7-0877c0776353 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '819d41a279e64291acc60de51e1530ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:06:33.338347 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c5dbb1d-ccd6-4a67-8ea7-0877c0776353 None admin] REQUEST_METHOD: `PUT` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:06:33.338863 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c5dbb1d-ccd6-4a67-8ea7-0877c0776353 None admin] SCRIPT_NAME: `/identity` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:06:33.339351 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c5dbb1d-ccd6-4a67-8ea7-0877c0776353 None admin] PATH_INFO: `/v3/projects/4bbf6c5abd684d899d09a08b0847d81c/users/8240f6e0b65545708f07e040c09e1490/roles/c798e3cf305b42dc8579aac6f3229a4b` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:06:33.358109 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c5dbb1d-ccd6-4a67-8ea7-0877c0776353 None admin] RBAC: Authorizing `identity:create_grant(project_id=4bbf6c5abd684d899d09a08b0847d81c, user_id=8240f6e0b65545708f07e040c09e1490, role_id=c798e3cf305b42dc8579aac6f3229a4b)` {{(pid=88551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:06:33.360018 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c5dbb1d-ccd6-4a67-8ea7-0877c0776353 None admin] RBAC: Authorization granted {{(pid=88551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:06:33.452746 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: [pid: 88551|app: 0|req: 283/583] 10.222.0.26 () {58 vars in 1439 bytes} [Wed Aug 17 19:06:33 2022] PUT /identity/v3/projects/4bbf6c5abd684d899d09a08b0847d81c/users/8240f6e0b65545708f07e040c09e1490/roles/c798e3cf305b42dc8579aac6f3229a4b => generated 0 bytes in 281 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 17 19:06:34.576987 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4bc78fd-5b86-4b49-84e5-c0bf59eaa101 None None] REQUEST_METHOD: `GET` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:06:34.577544 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4bc78fd-5b86-4b49-84e5-c0bf59eaa101 None None] SCRIPT_NAME: `/identity` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:06:34.577544 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4bc78fd-5b86-4b49-84e5-c0bf59eaa101 None None] PATH_INFO: `/` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:06:34.579193 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: [pid: 88550|app: 0|req: 301/584] 10.222.0.26 () {54 vars in 927 bytes} [Wed Aug 17 19:06:34 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 19:06:34.584436 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda5c8bc-3fb1-4fda-92d4-ac620d4a1cc5 None None] REQUEST_METHOD: `POST` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:06:34.584869 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda5c8bc-3fb1-4fda-92d4-ac620d4a1cc5 None None] SCRIPT_NAME: `/identity` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:06:34.585046 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda5c8bc-3fb1-4fda-92d4-ac620d4a1cc5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:06:34.605097 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.auth.core [None req-fda5c8bc-3fb1-4fda-92d4-ac620d4a1cc5 None None] MFA Rules not processed for user `819d41a279e64291acc60de51e1530ae`. Rule list: `[]` (Enabled: `True`). {{(pid=88551) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 19:06:34.606311 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.common.fernet_utils [None req-fda5c8bc-3fb1-4fda-92d4-ac620d4a1cc5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:06:34.656627 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG dbcounter [-] [88551] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:06:34.677458 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: [pid: 88551|app: 0|req: 284/585] 10.222.0.26 () {58 vars in 1024 bytes} [Wed Aug 17 19:06:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 17 19:06:35.011237 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4bc78fd-5b86-4b49-84e5-c0bf59eaa101 None None] Authenticating user token {{(pid=88550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:06:35.123672 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4bc78fd-5b86-4b49-84e5-c0bf59eaa101 None None] Validating token access rules against request {{(pid=88550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:06:35.144588 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG dbcounter [-] [88550] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:06:35.152924 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ccbf2a-7100-440d-91d6-8867a6da6c5d None None] REQUEST_METHOD: `GET` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:06:35.158900 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ccbf2a-7100-440d-91d6-8867a6da6c5d None None] SCRIPT_NAME: `/identity` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:06:35.158900 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ccbf2a-7100-440d-91d6-8867a6da6c5d None None] PATH_INFO: `/` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:06:35.158900 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: [pid: 88551|app: 0|req: 285/586] 10.222.0.26 () {54 vars in 927 bytes} [Wed Aug 17 19:06:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 19:06:35.160960 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb7f2c6a-52bf-4fc4-895c-c3ad0bd37ac3 None None] REQUEST_METHOD: `POST` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:06:35.161247 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb7f2c6a-52bf-4fc4-895c-c3ad0bd37ac3 None None] SCRIPT_NAME: `/identity` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:06:35.161596 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb7f2c6a-52bf-4fc4-895c-c3ad0bd37ac3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:06:35.163422 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4a4ba84-640d-4779-a577-0afad3cbc0c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '819d41a279e64291acc60de51e1530ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:06:35.164052 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a4ba84-640d-4779-a577-0afad3cbc0c7 None admin] REQUEST_METHOD: `GET` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:06:35.164328 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a4ba84-640d-4779-a577-0afad3cbc0c7 None admin] SCRIPT_NAME: `/identity` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:06:35.164596 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a4ba84-640d-4779-a577-0afad3cbc0c7 None admin] PATH_INFO: `/v3/roles/service` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:06:35.176415 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4a4ba84-640d-4779-a577-0afad3cbc0c7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 17 19:06:35.181809 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application [None req-f4a4ba84-640d-4779-a577-0afad3cbc0c7 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 17 19:06:35.181809 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 19:06:35.181809 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 19:06:35.181809 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 19:06:35.181809 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 19:06:35.181809 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 19:06:35.181809 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 19:06:35.181809 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 19:06:35.181809 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 19:06:35.181809 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 19:06:35.181809 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 19:06:35.181809 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 19:06:35.181809 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 17 19:06:35.181809 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 17 19:06:35.181809 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 17 19:06:35.181809 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 17 19:06:35.182849 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 17 19:06:35.182849 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 17 19:06:35.182849 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 17 19:06:35.182849 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 17 19:06:35.182849 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 19:06:35.182849 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 19:06:35.182849 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 19:06:35.182849 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 19:06:35.182849 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 19:06:35.182849 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 19:06:35.182849 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 19:06:35.182849 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application with Lock( Aug 17 19:06:35.182849 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 19:06:35.182849 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return self._enter() Aug 17 19:06:35.182849 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 19:06:35.182849 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 19:06:35.183722 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 19:06:35.183722 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return self.creator() Aug 17 19:06:35.183722 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 19:06:35.183722 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application created_value = creator( Aug 17 19:06:35.183722 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 17 19:06:35.183722 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 17 19:06:35.183722 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 17 19:06:35.183722 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 17 19:06:35.183722 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 17 19:06:35.183722 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 17 19:06:35.183722 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 17 19:06:35.183722 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application Aug 17 19:06:35.183722 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: [pid: 88550|app: 0|req: 302/587] 10.222.0.26 () {56 vars in 1102 bytes} [Wed Aug 17 19:06:35 2022] GET /identity/v3/roles/service => generated 85 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 19:06:35.185261 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.auth.core [None req-eb7f2c6a-52bf-4fc4-895c-c3ad0bd37ac3 None None] MFA Rules not processed for user `819d41a279e64291acc60de51e1530ae`. Rule list: `[]` (Enabled: `True`). {{(pid=88551) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 19:06:35.190596 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.common.fernet_utils [None req-eb7f2c6a-52bf-4fc4-895c-c3ad0bd37ac3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:06:35.191498 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4a4ba84-640d-4779-a577-0afad3cbc0c7 None admin] Authenticating user token {{(pid=88550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:06:35.283265 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: [pid: 88551|app: 0|req: 286/588] 10.222.0.26 () {58 vars in 1024 bytes} [Wed Aug 17 19:06:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 17 19:06:35.320287 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4a4ba84-640d-4779-a577-0afad3cbc0c7 None admin] Validating token access rules against request {{(pid=88550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:06:35.366452 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c2e60b3-c926-4124-ab7b-ed3e1fbf4f61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '819d41a279e64291acc60de51e1530ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:06:35.367090 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c2e60b3-c926-4124-ab7b-ed3e1fbf4f61 None admin] REQUEST_METHOD: `GET` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:06:35.367371 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c2e60b3-c926-4124-ab7b-ed3e1fbf4f61 None admin] SCRIPT_NAME: `/identity` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:06:35.367643 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c2e60b3-c926-4124-ab7b-ed3e1fbf4f61 None admin] PATH_INFO: `/v3/roles` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:06:35.368309 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c2e60b3-c926-4124-ab7b-ed3e1fbf4f61 None admin] RBAC: Adding query filter params (name=service) {{(pid=88550) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 19:06:35.368613 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c2e60b3-c926-4124-ab7b-ed3e1fbf4f61 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:06:35.370042 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c2e60b3-c926-4124-ab7b-ed3e1fbf4f61 None admin] RBAC: Authorization granted {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:06:35.379526 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: [pid: 88550|app: 0|req: 303/589] 10.222.0.26 () {56 vars in 1103 bytes} [Wed Aug 17 19:06:35 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 19:06:35.385116 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb7f2c6a-52bf-4fc4-895c-c3ad0bd37ac3 None None] Authenticating user token {{(pid=88551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:06:35.480851 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-886377cf-2c17-4175-90d4-57f748ddd21a None None] REQUEST_METHOD: `GET` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:06:35.481149 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-886377cf-2c17-4175-90d4-57f748ddd21a None None] SCRIPT_NAME: `/identity` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:06:35.482877 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-886377cf-2c17-4175-90d4-57f748ddd21a None None] PATH_INFO: `/` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:06:35.483740 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: [pid: 88550|app: 0|req: 304/590] 10.222.0.26 () {54 vars in 927 bytes} [Wed Aug 17 19:06:35 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 17 19:06:35.496996 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb7f2c6a-52bf-4fc4-895c-c3ad0bd37ac3 None None] Validating token access rules against request {{(pid=88551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:06:35.499137 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b2432e-e931-4e7f-9122-dc028ecc66ae None None] REQUEST_METHOD: `POST` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:06:35.499534 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b2432e-e931-4e7f-9122-dc028ecc66ae None None] SCRIPT_NAME: `/identity` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:06:35.499927 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b2432e-e931-4e7f-9122-dc028ecc66ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:06:35.514977 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG dbcounter [-] [88551] Writing DB stats keystone:SELECT=100 {{(pid=88551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:06:35.519992 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.auth.core [None req-99b2432e-e931-4e7f-9122-dc028ecc66ae None None] MFA Rules not processed for user `819d41a279e64291acc60de51e1530ae`. Rule list: `[]` (Enabled: `True`). {{(pid=88550) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 19:06:35.521176 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.common.fernet_utils [None req-99b2432e-e931-4e7f-9122-dc028ecc66ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:06:35.539883 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc927283-9ff6-4ad0-a6dd-aeedffdc8aaf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '819d41a279e64291acc60de51e1530ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:06:35.539883 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc927283-9ff6-4ad0-a6dd-aeedffdc8aaf None admin] REQUEST_METHOD: `GET` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:06:35.539883 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc927283-9ff6-4ad0-a6dd-aeedffdc8aaf None admin] SCRIPT_NAME: `/identity` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:06:35.540561 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc927283-9ff6-4ad0-a6dd-aeedffdc8aaf None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:06:35.552899 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc927283-9ff6-4ad0-a6dd-aeedffdc8aaf None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:06:35.555435 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc927283-9ff6-4ad0-a6dd-aeedffdc8aaf None admin] RBAC: Authorization granted {{(pid=88551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:06:35.565018 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG dbcounter [-] [88550] Writing DB stats keystone:SELECT=100 {{(pid=88550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:06:35.574092 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application [None req-cc927283-9ff6-4ad0-a6dd-aeedffdc8aaf None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 19:06:35.574092 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 19:06:35.574092 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 19:06:35.574092 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 19:06:35.574092 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 19:06:35.574092 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 19:06:35.574092 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 19:06:35.574092 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 19:06:35.574092 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 19:06:35.574092 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 19:06:35.574092 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 19:06:35.574092 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 19:06:35.574092 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 17 19:06:35.574092 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 17 19:06:35.574092 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 17 19:06:35.574092 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 17 19:06:35.575230 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 19:06:35.575230 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 19:06:35.575230 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 19:06:35.575230 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 19:06:35.575230 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 19:06:35.575230 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 19:06:35.575230 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 19:06:35.575230 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application with Lock( Aug 17 19:06:35.575230 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 19:06:35.575230 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application return self._enter() Aug 17 19:06:35.575230 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 19:06:35.575230 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 19:06:35.575230 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 19:06:35.575230 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application return self.creator() Aug 17 19:06:35.575230 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 19:06:35.575230 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application created_value = creator( Aug 17 19:06:35.575230 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 17 19:06:35.576243 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 17 19:06:35.576243 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 19:06:35.576243 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application Aug 17 19:06:35.579299 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: [pid: 88551|app: 0|req: 287/591] 10.222.0.26 () {56 vars in 1108 bytes} [Wed Aug 17 19:06:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 19:06:35.585638 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc927283-9ff6-4ad0-a6dd-aeedffdc8aaf None admin] Authenticating user token {{(pid=88551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:06:35.614663 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: [pid: 88550|app: 0|req: 305/592] 10.222.0.26 () {58 vars in 1024 bytes} [Wed Aug 17 19:06:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 17 19:06:35.670695 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99b2432e-e931-4e7f-9122-dc028ecc66ae None None] Authenticating user token {{(pid=88550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:06:35.725281 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc927283-9ff6-4ad0-a6dd-aeedffdc8aaf None admin] Validating token access rules against request {{(pid=88551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:06:35.772896 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c457d49c-6e0c-444b-a779-6bd3de26f874 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '819d41a279e64291acc60de51e1530ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:06:35.773489 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c457d49c-6e0c-444b-a779-6bd3de26f874 None admin] REQUEST_METHOD: `GET` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:06:35.773764 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c457d49c-6e0c-444b-a779-6bd3de26f874 None admin] SCRIPT_NAME: `/identity` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:06:35.774036 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c457d49c-6e0c-444b-a779-6bd3de26f874 None admin] PATH_INFO: `/v3/domains` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:06:35.774700 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c457d49c-6e0c-444b-a779-6bd3de26f874 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88551) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 19:06:35.775000 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c457d49c-6e0c-444b-a779-6bd3de26f874 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:06:35.776789 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c457d49c-6e0c-444b-a779-6bd3de26f874 None admin] RBAC: Authorization granted {{(pid=88551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:06:35.793716 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: [pid: 88551|app: 0|req: 288/593] 10.222.0.26 () {56 vars in 1109 bytes} [Wed Aug 17 19:06:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 19:06:35.793716 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee83079-532c-4a19-b90f-7a974c2392d3 None None] REQUEST_METHOD: `GET` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:06:35.793716 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee83079-532c-4a19-b90f-7a974c2392d3 None None] SCRIPT_NAME: `/identity` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:06:35.793716 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee83079-532c-4a19-b90f-7a974c2392d3 None None] PATH_INFO: `/` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:06:35.793716 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: [pid: 88551|app: 0|req: 289/594] 10.222.0.26 () {54 vars in 927 bytes} [Wed Aug 17 19:06:35 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 19:06:35.798249 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b7c8c55-4a2e-4d88-8224-68c9a32ef864 None None] REQUEST_METHOD: `POST` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:06:35.798529 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b7c8c55-4a2e-4d88-8224-68c9a32ef864 None None] SCRIPT_NAME: `/identity` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:06:35.798819 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b7c8c55-4a2e-4d88-8224-68c9a32ef864 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:06:35.813947 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99b2432e-e931-4e7f-9122-dc028ecc66ae None None] Validating token access rules against request {{(pid=88550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:06:35.816811 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.auth.core [None req-1b7c8c55-4a2e-4d88-8224-68c9a32ef864 None None] MFA Rules not processed for user `819d41a279e64291acc60de51e1530ae`. Rule list: `[]` (Enabled: `True`). {{(pid=88551) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 19:06:35.818100 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.common.fernet_utils [None req-1b7c8c55-4a2e-4d88-8224-68c9a32ef864 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:06:35.838344 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG dbcounter [-] [88551] Writing DB stats keystone:SELECT=100 {{(pid=88551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:06:35.851221 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb3db15e-ee03-459f-b68d-3be0b6f62df9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '819d41a279e64291acc60de51e1530ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:06:35.859174 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb3db15e-ee03-459f-b68d-3be0b6f62df9 None admin] REQUEST_METHOD: `GET` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:06:35.859174 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb3db15e-ee03-459f-b68d-3be0b6f62df9 None admin] SCRIPT_NAME: `/identity` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:06:35.859174 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb3db15e-ee03-459f-b68d-3be0b6f62df9 None admin] PATH_INFO: `/v3/roles/service` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:06:35.863982 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb3db15e-ee03-459f-b68d-3be0b6f62df9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 17 19:06:35.869421 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application [None req-bb3db15e-ee03-459f-b68d-3be0b6f62df9 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 17 19:06:35.869421 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 19:06:35.869421 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 19:06:35.869421 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 19:06:35.869421 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 19:06:35.869421 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 19:06:35.869421 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 19:06:35.869421 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 19:06:35.869421 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 19:06:35.869421 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 19:06:35.869421 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 19:06:35.869421 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 19:06:35.869421 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 17 19:06:35.869421 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 17 19:06:35.869421 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 17 19:06:35.869421 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 17 19:06:35.870516 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 17 19:06:35.870516 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 17 19:06:35.870516 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 17 19:06:35.870516 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 17 19:06:35.870516 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 19:06:35.870516 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 19:06:35.870516 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 19:06:35.870516 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 19:06:35.870516 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 19:06:35.870516 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 19:06:35.870516 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 19:06:35.870516 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application with Lock( Aug 17 19:06:35.870516 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 19:06:35.870516 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return self._enter() Aug 17 19:06:35.870516 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 19:06:35.870516 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 19:06:35.871414 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 19:06:35.871414 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return self.creator() Aug 17 19:06:35.871414 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 19:06:35.871414 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application created_value = creator( Aug 17 19:06:35.871414 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 17 19:06:35.871414 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 17 19:06:35.871414 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 17 19:06:35.871414 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 17 19:06:35.871414 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 17 19:06:35.871414 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 17 19:06:35.871414 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 17 19:06:35.871414 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application Aug 17 19:06:35.871414 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: [pid: 88550|app: 0|req: 306/595] 10.222.0.26 () {56 vars in 1102 bytes} [Wed Aug 17 19:06:35 2022] GET /identity/v3/roles/service => generated 85 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 19:06:35.872141 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb3db15e-ee03-459f-b68d-3be0b6f62df9 None admin] Authenticating user token {{(pid=88550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:06:35.906916 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: [pid: 88551|app: 0|req: 290/596] 10.222.0.26 () {58 vars in 1024 bytes} [Wed Aug 17 19:06:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 17 19:06:35.906916 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b7c8c55-4a2e-4d88-8224-68c9a32ef864 None None] Authenticating user token {{(pid=88551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:06:35.912050 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG dbcounter [-] [88550] Writing DB stats keystone:SELECT=100 {{(pid=88550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:06:36.004940 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb3db15e-ee03-459f-b68d-3be0b6f62df9 None admin] Validating token access rules against request {{(pid=88550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:06:36.044589 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fd2f5b2-f44a-49e8-9bec-4d7469d2d733 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '819d41a279e64291acc60de51e1530ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:06:36.044811 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b7c8c55-4a2e-4d88-8224-68c9a32ef864 None None] Validating token access rules against request {{(pid=88551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:06:36.045470 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd2f5b2-f44a-49e8-9bec-4d7469d2d733 None admin] REQUEST_METHOD: `GET` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:06:36.045931 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd2f5b2-f44a-49e8-9bec-4d7469d2d733 None admin] SCRIPT_NAME: `/identity` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:06:36.046247 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd2f5b2-f44a-49e8-9bec-4d7469d2d733 None admin] PATH_INFO: `/v3/users/nova` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:06:36.054405 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fd2f5b2-f44a-49e8-9bec-4d7469d2d733 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:06:36.056019 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fd2f5b2-f44a-49e8-9bec-4d7469d2d733 None admin] RBAC: Authorization granted {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:06:36.068193 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application [None req-3fd2f5b2-f44a-49e8-9bec-4d7469d2d733 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 17 19:06:36.068193 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 19:06:36.068193 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 19:06:36.068193 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 19:06:36.068193 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 19:06:36.068193 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 19:06:36.068193 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 19:06:36.068193 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 19:06:36.068193 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 19:06:36.068193 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 19:06:36.068193 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 19:06:36.068193 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 19:06:36.068193 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 17 19:06:36.068193 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 17 19:06:36.068193 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 17 19:06:36.068193 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 17 19:06:36.069436 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 19:06:36.069436 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 19:06:36.069436 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 17 19:06:36.069436 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 17 19:06:36.069436 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 17 19:06:36.069436 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 17 19:06:36.069436 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 19:06:36.069436 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 19:06:36.069436 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 19:06:36.069436 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 19:06:36.069436 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 19:06:36.069436 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application with Lock( Aug 17 19:06:36.069436 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 19:06:36.069436 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return self._enter() Aug 17 19:06:36.069436 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 19:06:36.069436 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 19:06:36.069436 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 19:06:36.069436 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return self.creator() Aug 17 19:06:36.070639 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 19:06:36.070639 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application created_value = creator( Aug 17 19:06:36.070639 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 17 19:06:36.070639 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 17 19:06:36.070639 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 17 19:06:36.070639 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 17 19:06:36.070639 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 17 19:06:36.070639 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 17 19:06:36.070639 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 17 19:06:36.070639 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application Aug 17 19:06:36.074283 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: [pid: 88550|app: 0|req: 307/597] 10.222.0.26 () {56 vars in 1093 bytes} [Wed Aug 17 19:06:35 2022] GET /identity/v3/users/nova => generated 82 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 19:06:36.074624 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fd2f5b2-f44a-49e8-9bec-4d7469d2d733 None admin] Authenticating user token {{(pid=88550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:06:36.090955 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4c8396a-67db-40ab-be17-fb5ab1ddf6a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '819d41a279e64291acc60de51e1530ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:06:36.092299 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c8396a-67db-40ab-be17-fb5ab1ddf6a1 None admin] REQUEST_METHOD: `GET` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:06:36.092606 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c8396a-67db-40ab-be17-fb5ab1ddf6a1 None admin] SCRIPT_NAME: `/identity` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:06:36.092884 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c8396a-67db-40ab-be17-fb5ab1ddf6a1 None admin] PATH_INFO: `/v3/roles` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:06:36.093604 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4c8396a-67db-40ab-be17-fb5ab1ddf6a1 None admin] RBAC: Adding query filter params (name=service) {{(pid=88551) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 19:06:36.093919 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4c8396a-67db-40ab-be17-fb5ab1ddf6a1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:06:36.095430 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4c8396a-67db-40ab-be17-fb5ab1ddf6a1 None admin] RBAC: Authorization granted {{(pid=88551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:06:36.106580 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: [pid: 88551|app: 0|req: 291/598] 10.222.0.26 () {56 vars in 1103 bytes} [Wed Aug 17 19:06:35 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 19:06:36.106580 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4c8396a-67db-40ab-be17-fb5ab1ddf6a1 None admin] Authenticating user token {{(pid=88551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:06:36.127138 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG dbcounter [-] [88551] Writing DB stats keystone:SELECT=100 {{(pid=88551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:06:36.198753 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG dbcounter [-] [88550] Writing DB stats keystone:SELECT=100 {{(pid=88550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:06:36.209735 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fd2f5b2-f44a-49e8-9bec-4d7469d2d733 None admin] Validating token access rules against request {{(pid=88550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:06:36.222107 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4c8396a-67db-40ab-be17-fb5ab1ddf6a1 None admin] Validating token access rules against request {{(pid=88551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:06:36.252823 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cc54889-f307-4687-845f-fc73d86e5c9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '819d41a279e64291acc60de51e1530ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:06:36.253768 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc54889-f307-4687-845f-fc73d86e5c9f None admin] REQUEST_METHOD: `GET` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:06:36.254180 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc54889-f307-4687-845f-fc73d86e5c9f None admin] SCRIPT_NAME: `/identity` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:06:36.254658 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc54889-f307-4687-845f-fc73d86e5c9f None admin] PATH_INFO: `/v3/roles/service` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:06:36.258117 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f95708c-750c-417f-b7c9-e0b8a3b10c70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '819d41a279e64291acc60de51e1530ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:06:36.259170 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f95708c-750c-417f-b7c9-e0b8a3b10c70 None admin] REQUEST_METHOD: `GET` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:06:36.259450 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f95708c-750c-417f-b7c9-e0b8a3b10c70 None admin] SCRIPT_NAME: `/identity` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:06:36.259725 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f95708c-750c-417f-b7c9-e0b8a3b10c70 None admin] PATH_INFO: `/v3/users` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:06:36.260458 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f95708c-750c-417f-b7c9-e0b8a3b10c70 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=88551) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 19:06:36.260763 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f95708c-750c-417f-b7c9-e0b8a3b10c70 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:06:36.262262 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f95708c-750c-417f-b7c9-e0b8a3b10c70 None admin] RBAC: Authorization granted {{(pid=88551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:06:36.268255 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cc54889-f307-4687-845f-fc73d86e5c9f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 17 19:06:36.273483 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application [None req-2cc54889-f307-4687-845f-fc73d86e5c9f None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 17 19:06:36.273483 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 19:06:36.273483 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 19:06:36.273483 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 19:06:36.273483 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 19:06:36.273483 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 19:06:36.273483 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 19:06:36.273483 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 19:06:36.273483 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 19:06:36.273483 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 19:06:36.273483 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 19:06:36.273483 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 19:06:36.273483 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 17 19:06:36.273483 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 17 19:06:36.273483 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 17 19:06:36.273483 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 17 19:06:36.278821 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 17 19:06:36.278821 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 17 19:06:36.278821 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 17 19:06:36.278821 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 17 19:06:36.278821 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 19:06:36.278821 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 19:06:36.278821 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 19:06:36.278821 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 19:06:36.278821 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 19:06:36.278821 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 19:06:36.278821 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 19:06:36.278821 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application with Lock( Aug 17 19:06:36.278821 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 19:06:36.278821 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return self._enter() Aug 17 19:06:36.278821 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 19:06:36.278821 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 19:06:36.280379 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 19:06:36.280379 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return self.creator() Aug 17 19:06:36.280379 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 19:06:36.280379 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application created_value = creator( Aug 17 19:06:36.280379 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 17 19:06:36.280379 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 17 19:06:36.280379 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 17 19:06:36.280379 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 17 19:06:36.280379 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 17 19:06:36.280379 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 17 19:06:36.280379 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 17 19:06:36.280379 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application Aug 17 19:06:36.280379 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: [pid: 88550|app: 0|req: 308/599] 10.222.0.26 () {56 vars in 1102 bytes} [Wed Aug 17 19:06:36 2022] GET /identity/v3/roles/service => generated 85 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 19:06:36.280379 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cc54889-f307-4687-845f-fc73d86e5c9f None admin] Authenticating user token {{(pid=88550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:06:36.283543 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: [pid: 88551|app: 0|req: 292/600] 10.222.0.26 () {56 vars in 1133 bytes} [Wed Aug 17 19:06:36 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 19:06:36.284260 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f95708c-750c-417f-b7c9-e0b8a3b10c70 None admin] Authenticating user token {{(pid=88551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:06:36.359664 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG dbcounter [-] [88551] Writing DB stats keystone:SELECT=100 {{(pid=88551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:06:36.377640 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cc54889-f307-4687-845f-fc73d86e5c9f None admin] Validating token access rules against request {{(pid=88550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:06:36.385369 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f95708c-750c-417f-b7c9-e0b8a3b10c70 None admin] Validating token access rules against request {{(pid=88551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:06:36.410230 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09aef375-4123-4727-8408-d0f5ddf1ecea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '819d41a279e64291acc60de51e1530ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:06:36.410870 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09aef375-4123-4727-8408-d0f5ddf1ecea None admin] REQUEST_METHOD: `GET` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:06:36.411143 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09aef375-4123-4727-8408-d0f5ddf1ecea None admin] SCRIPT_NAME: `/identity` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:06:36.411415 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09aef375-4123-4727-8408-d0f5ddf1ecea None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:06:36.417983 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a0c2fc7-6936-4923-84fc-4f8350cba790 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '819d41a279e64291acc60de51e1530ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:06:36.418629 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a0c2fc7-6936-4923-84fc-4f8350cba790 None admin] REQUEST_METHOD: `GET` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:06:36.418906 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a0c2fc7-6936-4923-84fc-4f8350cba790 None admin] SCRIPT_NAME: `/identity` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:06:36.419176 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a0c2fc7-6936-4923-84fc-4f8350cba790 None admin] PATH_INFO: `/v3/roles/service` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:06:36.422426 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09aef375-4123-4727-8408-d0f5ddf1ecea None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:06:36.423903 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09aef375-4123-4727-8408-d0f5ddf1ecea None admin] RBAC: Authorization granted {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:06:36.429911 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a0c2fc7-6936-4923-84fc-4f8350cba790 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 17 19:06:36.434620 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application [None req-3a0c2fc7-6936-4923-84fc-4f8350cba790 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 17 19:06:36.434620 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 19:06:36.434620 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 19:06:36.434620 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 19:06:36.434620 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 19:06:36.434620 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 19:06:36.434620 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 19:06:36.434620 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 19:06:36.434620 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 19:06:36.434620 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 19:06:36.434620 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 19:06:36.434620 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 19:06:36.434620 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 17 19:06:36.434620 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 17 19:06:36.434620 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 17 19:06:36.434620 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 17 19:06:36.436009 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 17 19:06:36.436009 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 17 19:06:36.436009 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 17 19:06:36.436009 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 17 19:06:36.436009 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 19:06:36.436009 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 19:06:36.436009 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 19:06:36.436009 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 19:06:36.436009 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 19:06:36.436009 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 19:06:36.436009 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 19:06:36.436009 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application with Lock( Aug 17 19:06:36.436009 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 19:06:36.436009 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application return self._enter() Aug 17 19:06:36.436009 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 19:06:36.436009 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 19:06:36.437037 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 19:06:36.437037 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application return self.creator() Aug 17 19:06:36.437037 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 19:06:36.437037 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application created_value = creator( Aug 17 19:06:36.437037 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 17 19:06:36.437037 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 17 19:06:36.437037 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 17 19:06:36.437037 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 17 19:06:36.437037 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 17 19:06:36.437037 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 17 19:06:36.437037 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 17 19:06:36.437037 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application Aug 17 19:06:36.437037 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: [pid: 88551|app: 0|req: 293/601] 10.222.0.26 () {56 vars in 1102 bytes} [Wed Aug 17 19:06:36 2022] GET /identity/v3/roles/service => generated 85 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 19:06:36.438021 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a0c2fc7-6936-4923-84fc-4f8350cba790 None admin] Authenticating user token {{(pid=88551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:06:36.440765 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application [None req-09aef375-4123-4727-8408-d0f5ddf1ecea None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 19:06:36.440765 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 19:06:36.440765 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 19:06:36.440765 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 19:06:36.440765 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 19:06:36.440765 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 19:06:36.440765 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 19:06:36.440765 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 19:06:36.440765 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 19:06:36.440765 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 19:06:36.440765 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 19:06:36.440765 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 19:06:36.440765 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 17 19:06:36.440765 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 17 19:06:36.440765 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 17 19:06:36.440765 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 17 19:06:36.441939 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 19:06:36.441939 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 19:06:36.441939 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 19:06:36.441939 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 19:06:36.441939 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 19:06:36.441939 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 19:06:36.441939 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 19:06:36.441939 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application with Lock( Aug 17 19:06:36.441939 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 19:06:36.441939 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return self._enter() Aug 17 19:06:36.441939 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 19:06:36.441939 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 19:06:36.441939 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 19:06:36.441939 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return self.creator() Aug 17 19:06:36.441939 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 19:06:36.441939 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application created_value = creator( Aug 17 19:06:36.441939 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 17 19:06:36.443058 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 17 19:06:36.443058 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 19:06:36.443058 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application Aug 17 19:06:36.444301 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: [pid: 88550|app: 0|req: 309/602] 10.222.0.26 () {56 vars in 1108 bytes} [Wed Aug 17 19:06:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 19:06:36.444587 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09aef375-4123-4727-8408-d0f5ddf1ecea None admin] Authenticating user token {{(pid=88550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:06:36.447467 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG dbcounter [-] [88550] Writing DB stats keystone:SELECT=100 {{(pid=88550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:06:36.542437 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a0c2fc7-6936-4923-84fc-4f8350cba790 None admin] Validating token access rules against request {{(pid=88551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:06:36.544861 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09aef375-4123-4727-8408-d0f5ddf1ecea None admin] Validating token access rules against request {{(pid=88550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:06:36.579424 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc7ac85f-07f2-4cff-8933-b9da64348332 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '819d41a279e64291acc60de51e1530ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:06:36.580398 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc7ac85f-07f2-4cff-8933-b9da64348332 None admin] REQUEST_METHOD: `GET` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:06:36.580826 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc7ac85f-07f2-4cff-8933-b9da64348332 None admin] SCRIPT_NAME: `/identity` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:06:36.580938 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f03a1d7d-8c09-411f-afdf-f3b3063562d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '819d41a279e64291acc60de51e1530ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:06:36.581267 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc7ac85f-07f2-4cff-8933-b9da64348332 None admin] PATH_INFO: `/v3/roles` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:06:36.581782 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f03a1d7d-8c09-411f-afdf-f3b3063562d6 None admin] REQUEST_METHOD: `GET` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:06:36.582226 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f03a1d7d-8c09-411f-afdf-f3b3063562d6 None admin] SCRIPT_NAME: `/identity` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:06:36.582350 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc7ac85f-07f2-4cff-8933-b9da64348332 None admin] RBAC: Adding query filter params (name=service) {{(pid=88551) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 19:06:36.582701 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f03a1d7d-8c09-411f-afdf-f3b3063562d6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:06:36.582870 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc7ac85f-07f2-4cff-8933-b9da64348332 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:06:36.585210 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc7ac85f-07f2-4cff-8933-b9da64348332 None admin] RBAC: Authorization granted {{(pid=88551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:06:36.587204 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG dbcounter [-] [88551] Writing DB stats keystone:SELECT=100 {{(pid=88551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:06:36.598988 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: [pid: 88551|app: 0|req: 294/603] 10.222.0.26 () {56 vars in 1103 bytes} [Wed Aug 17 19:06:36 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 19:06:36.600130 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc7ac85f-07f2-4cff-8933-b9da64348332 None admin] Authenticating user token {{(pid=88551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:06:36.660845 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f03a1d7d-8c09-411f-afdf-f3b3063562d6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:06:36.662266 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f03a1d7d-8c09-411f-afdf-f3b3063562d6 None admin] RBAC: Authorization granted {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:06:36.664106 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG dbcounter [-] [88550] Writing DB stats keystone:SELECT=100 {{(pid=88550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:06:36.700500 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc7ac85f-07f2-4cff-8933-b9da64348332 None admin] Validating token access rules against request {{(pid=88551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:06:36.734060 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6116ea8c-b6a4-44f9-a4b0-2cd8023ea818 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '819d41a279e64291acc60de51e1530ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:06:36.734688 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6116ea8c-b6a4-44f9-a4b0-2cd8023ea818 None admin] REQUEST_METHOD: `GET` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:06:36.734964 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6116ea8c-b6a4-44f9-a4b0-2cd8023ea818 None admin] SCRIPT_NAME: `/identity` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:06:36.735235 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6116ea8c-b6a4-44f9-a4b0-2cd8023ea818 None admin] PATH_INFO: `/v3/roles` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:06:36.735943 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6116ea8c-b6a4-44f9-a4b0-2cd8023ea818 None admin] RBAC: Adding query filter params (name=service) {{(pid=88551) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 19:06:36.736250 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6116ea8c-b6a4-44f9-a4b0-2cd8023ea818 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:06:36.737619 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6116ea8c-b6a4-44f9-a4b0-2cd8023ea818 None admin] RBAC: Authorization granted {{(pid=88551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:06:36.745884 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: [pid: 88551|app: 0|req: 295/604] 10.222.0.26 () {56 vars in 1103 bytes} [Wed Aug 17 19:06:36 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 19:06:36.746729 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6116ea8c-b6a4-44f9-a4b0-2cd8023ea818 None admin] Authenticating user token {{(pid=88551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:06:36.765644 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: [pid: 88550|app: 0|req: 310/605] 10.222.0.26 () {58 vars in 1282 bytes} [Wed Aug 17 19:06:36 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 317 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 17 19:06:36.765644 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f03a1d7d-8c09-411f-afdf-f3b3063562d6 None admin] Authenticating user token {{(pid=88550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:06:36.814111 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG dbcounter [-] [88551] Writing DB stats keystone:SELECT=100 {{(pid=88551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:06:36.860729 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f03a1d7d-8c09-411f-afdf-f3b3063562d6 None admin] Validating token access rules against request {{(pid=88550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:06:36.861112 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6116ea8c-b6a4-44f9-a4b0-2cd8023ea818 None admin] Validating token access rules against request {{(pid=88551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:06:36.862285 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG dbcounter [-] [88550] Writing DB stats keystone:SELECT=100 {{(pid=88550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:06:36.894683 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6434ea92-8e77-4d8e-a1e0-5fcd4b78a20a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '819d41a279e64291acc60de51e1530ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:06:36.894922 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e015dcc2-6773-45a6-a004-dc05cc0bfb82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '819d41a279e64291acc60de51e1530ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:06:36.895277 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6434ea92-8e77-4d8e-a1e0-5fcd4b78a20a None admin] REQUEST_METHOD: `GET` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:06:36.895451 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e015dcc2-6773-45a6-a004-dc05cc0bfb82 None admin] REQUEST_METHOD: `GET` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:06:36.895552 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6434ea92-8e77-4d8e-a1e0-5fcd4b78a20a None admin] SCRIPT_NAME: `/identity` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:06:36.895732 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e015dcc2-6773-45a6-a004-dc05cc0bfb82 None admin] SCRIPT_NAME: `/identity` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:06:36.895850 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6434ea92-8e77-4d8e-a1e0-5fcd4b78a20a None admin] PATH_INFO: `/v3/domains` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:06:36.896070 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e015dcc2-6773-45a6-a004-dc05cc0bfb82 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:06:36.896480 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6434ea92-8e77-4d8e-a1e0-5fcd4b78a20a None admin] RBAC: Adding query filter params (name=Default) {{(pid=88551) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 19:06:36.896781 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6434ea92-8e77-4d8e-a1e0-5fcd4b78a20a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:06:36.898153 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6434ea92-8e77-4d8e-a1e0-5fcd4b78a20a None admin] RBAC: Authorization granted {{(pid=88551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:06:36.905750 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e015dcc2-6773-45a6-a004-dc05cc0bfb82 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:06:36.907237 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e015dcc2-6773-45a6-a004-dc05cc0bfb82 None admin] RBAC: Authorization granted {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:06:36.909598 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: [pid: 88551|app: 0|req: 296/606] 10.222.0.26 () {56 vars in 1109 bytes} [Wed Aug 17 19:06:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 19:06:36.910368 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6434ea92-8e77-4d8e-a1e0-5fcd4b78a20a None admin] Authenticating user token {{(pid=88551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:06:36.923575 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application [None req-e015dcc2-6773-45a6-a004-dc05cc0bfb82 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 19:06:36.923575 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 19:06:36.923575 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 19:06:36.923575 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 19:06:36.923575 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 19:06:36.923575 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 19:06:36.923575 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 19:06:36.923575 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 19:06:36.923575 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 19:06:36.923575 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 19:06:36.923575 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 19:06:36.923575 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 19:06:36.923575 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 17 19:06:36.923575 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 17 19:06:36.923575 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 17 19:06:36.923575 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 17 19:06:36.924702 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 19:06:36.924702 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 19:06:36.924702 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 19:06:36.924702 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 19:06:36.924702 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 19:06:36.924702 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 19:06:36.924702 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 19:06:36.924702 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application with Lock( Aug 17 19:06:36.924702 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 19:06:36.924702 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return self._enter() Aug 17 19:06:36.924702 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 19:06:36.924702 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 19:06:36.924702 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 19:06:36.924702 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return self.creator() Aug 17 19:06:36.924702 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 19:06:36.924702 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application created_value = creator( Aug 17 19:06:36.924702 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 17 19:06:36.925623 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 17 19:06:36.925623 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 19:06:36.925623 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application Aug 17 19:06:36.925623 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: [pid: 88550|app: 0|req: 311/607] 10.222.0.26 () {56 vars in 1108 bytes} [Wed Aug 17 19:06:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 19:06:36.925623 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e015dcc2-6773-45a6-a004-dc05cc0bfb82 None admin] Authenticating user token {{(pid=88550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:06:37.018995 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6434ea92-8e77-4d8e-a1e0-5fcd4b78a20a None admin] Validating token access rules against request {{(pid=88551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:06:37.027434 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e015dcc2-6773-45a6-a004-dc05cc0bfb82 None admin] Validating token access rules against request {{(pid=88550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:06:37.037785 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG dbcounter [-] [88551] Writing DB stats keystone:SELECT=100 {{(pid=88551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:06:37.054563 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cbf2a75-ac18-4752-b621-7aee7b5d0287 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '819d41a279e64291acc60de51e1530ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:06:37.055209 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cbf2a75-ac18-4752-b621-7aee7b5d0287 None admin] REQUEST_METHOD: `GET` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:06:37.055484 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cbf2a75-ac18-4752-b621-7aee7b5d0287 None admin] SCRIPT_NAME: `/identity` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:06:37.055754 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cbf2a75-ac18-4752-b621-7aee7b5d0287 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:06:37.062547 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e3f65e9-da81-4fa0-ad53-2adf9af586e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '819d41a279e64291acc60de51e1530ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:06:37.063225 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e3f65e9-da81-4fa0-ad53-2adf9af586e1 None admin] REQUEST_METHOD: `GET` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:06:37.063502 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e3f65e9-da81-4fa0-ad53-2adf9af586e1 None admin] SCRIPT_NAME: `/identity` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:06:37.063775 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e3f65e9-da81-4fa0-ad53-2adf9af586e1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:06:37.066323 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cbf2a75-ac18-4752-b621-7aee7b5d0287 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:06:37.067833 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cbf2a75-ac18-4752-b621-7aee7b5d0287 None admin] RBAC: Authorization granted {{(pid=88551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:06:37.074458 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e3f65e9-da81-4fa0-ad53-2adf9af586e1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:06:37.076034 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e3f65e9-da81-4fa0-ad53-2adf9af586e1 None admin] RBAC: Authorization granted {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:06:37.083406 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application [None req-5cbf2a75-ac18-4752-b621-7aee7b5d0287 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 19:06:37.083406 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 19:06:37.083406 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 19:06:37.083406 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 19:06:37.083406 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 19:06:37.083406 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 19:06:37.083406 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 19:06:37.083406 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 19:06:37.083406 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 19:06:37.083406 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 19:06:37.083406 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 19:06:37.083406 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 19:06:37.083406 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 17 19:06:37.083406 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 17 19:06:37.083406 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 17 19:06:37.083406 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 17 19:06:37.084596 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 19:06:37.084596 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 19:06:37.084596 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 19:06:37.084596 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 19:06:37.084596 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 19:06:37.084596 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 19:06:37.084596 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 19:06:37.084596 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application with Lock( Aug 17 19:06:37.084596 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 19:06:37.084596 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application return self._enter() Aug 17 19:06:37.084596 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 19:06:37.084596 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 19:06:37.084596 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 19:06:37.084596 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application return self.creator() Aug 17 19:06:37.084596 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 19:06:37.084596 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application created_value = creator( Aug 17 19:06:37.084596 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 17 19:06:37.085692 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 17 19:06:37.085692 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 19:06:37.085692 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application Aug 17 19:06:37.085692 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: [pid: 88551|app: 0|req: 297/608] 10.222.0.26 () {56 vars in 1108 bytes} [Wed Aug 17 19:06:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 19:06:37.085692 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cbf2a75-ac18-4752-b621-7aee7b5d0287 None admin] Authenticating user token {{(pid=88551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:06:37.092148 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application [None req-9e3f65e9-da81-4fa0-ad53-2adf9af586e1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 19:06:37.092148 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 19:06:37.092148 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 19:06:37.092148 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 19:06:37.092148 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 19:06:37.092148 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 19:06:37.092148 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 19:06:37.092148 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 19:06:37.092148 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 19:06:37.092148 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 19:06:37.092148 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 19:06:37.092148 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 19:06:37.092148 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 17 19:06:37.092148 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 17 19:06:37.092148 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 17 19:06:37.092148 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 17 19:06:37.093308 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 19:06:37.093308 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 19:06:37.093308 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 19:06:37.093308 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 19:06:37.093308 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 19:06:37.093308 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 19:06:37.093308 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 19:06:37.093308 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application with Lock( Aug 17 19:06:37.093308 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 19:06:37.093308 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return self._enter() Aug 17 19:06:37.093308 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 19:06:37.093308 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 19:06:37.093308 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 19:06:37.093308 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return self.creator() Aug 17 19:06:37.093308 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 19:06:37.093308 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application created_value = creator( Aug 17 19:06:37.093308 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 17 19:06:37.094237 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 17 19:06:37.094237 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 19:06:37.094237 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application Aug 17 19:06:37.094237 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: [pid: 88550|app: 0|req: 312/609] 10.222.0.26 () {56 vars in 1108 bytes} [Wed Aug 17 19:06:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 19:06:37.094237 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e3f65e9-da81-4fa0-ad53-2adf9af586e1 None admin] Authenticating user token {{(pid=88550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:06:37.102714 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG dbcounter [-] [88550] Writing DB stats keystone:SELECT=100 {{(pid=88550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:06:37.189371 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cbf2a75-ac18-4752-b621-7aee7b5d0287 None admin] Validating token access rules against request {{(pid=88551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:06:37.197002 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e3f65e9-da81-4fa0-ad53-2adf9af586e1 None admin] Validating token access rules against request {{(pid=88550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:06:37.223476 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a766f830-8bee-4de9-8964-8913ab30362d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '819d41a279e64291acc60de51e1530ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:06:37.224090 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a766f830-8bee-4de9-8964-8913ab30362d None admin] REQUEST_METHOD: `GET` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:06:37.224394 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a766f830-8bee-4de9-8964-8913ab30362d None admin] SCRIPT_NAME: `/identity` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:06:37.224669 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a766f830-8bee-4de9-8964-8913ab30362d None admin] PATH_INFO: `/v3/users/glance` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:06:37.230381 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7f38d45-57eb-420a-9dec-5e7bc009511c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '819d41a279e64291acc60de51e1530ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:06:37.231002 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f38d45-57eb-420a-9dec-5e7bc009511c None admin] REQUEST_METHOD: `GET` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:06:37.231287 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f38d45-57eb-420a-9dec-5e7bc009511c None admin] SCRIPT_NAME: `/identity` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:06:37.231565 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f38d45-57eb-420a-9dec-5e7bc009511c None admin] PATH_INFO: `/v3/domains` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:06:37.232234 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7f38d45-57eb-420a-9dec-5e7bc009511c None admin] RBAC: Adding query filter params (name=Default) {{(pid=88550) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 19:06:37.232331 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a766f830-8bee-4de9-8964-8913ab30362d None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=88551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:06:37.232547 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7f38d45-57eb-420a-9dec-5e7bc009511c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:06:37.233876 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a766f830-8bee-4de9-8964-8913ab30362d None admin] RBAC: Authorization granted {{(pid=88551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:06:37.233972 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7f38d45-57eb-420a-9dec-5e7bc009511c None admin] RBAC: Authorization granted {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:06:37.245024 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application [None req-a766f830-8bee-4de9-8964-8913ab30362d None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Aug 17 19:06:37.245024 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 19:06:37.245024 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 19:06:37.245024 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 19:06:37.245024 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 19:06:37.245024 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 19:06:37.245024 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 19:06:37.245024 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 19:06:37.245024 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 19:06:37.245024 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 19:06:37.245024 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 19:06:37.245024 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 19:06:37.245024 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 17 19:06:37.245024 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 17 19:06:37.245024 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 17 19:06:37.245024 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 17 19:06:37.251832 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 19:06:37.251832 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 19:06:37.251832 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 17 19:06:37.251832 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 17 19:06:37.251832 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 17 19:06:37.251832 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 17 19:06:37.251832 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 19:06:37.251832 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 19:06:37.251832 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 19:06:37.251832 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 19:06:37.251832 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 19:06:37.251832 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application with Lock( Aug 17 19:06:37.251832 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 19:06:37.251832 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application return self._enter() Aug 17 19:06:37.251832 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 19:06:37.251832 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 19:06:37.251832 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 19:06:37.251832 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application return self.creator() Aug 17 19:06:37.253010 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 19:06:37.253010 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application created_value = creator( Aug 17 19:06:37.253010 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 17 19:06:37.253010 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 17 19:06:37.253010 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 17 19:06:37.253010 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 17 19:06:37.253010 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 17 19:06:37.253010 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 17 19:06:37.253010 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Aug 17 19:06:37.253010 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application Aug 17 19:06:37.253684 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: [pid: 88550|app: 0|req: 313/610] 10.222.0.26 () {56 vars in 1109 bytes} [Wed Aug 17 19:06:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 19:06:37.253772 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: [pid: 88551|app: 0|req: 298/611] 10.222.0.26 () {56 vars in 1099 bytes} [Wed Aug 17 19:06:37 2022] GET /identity/v3/users/glance => generated 84 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 19:06:37.253853 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7f38d45-57eb-420a-9dec-5e7bc009511c None admin] Authenticating user token {{(pid=88550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:06:37.253944 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a766f830-8bee-4de9-8964-8913ab30362d None admin] Authenticating user token {{(pid=88551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:06:37.287833 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG dbcounter [-] [88551] Writing DB stats keystone:SELECT=100 {{(pid=88551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:06:37.320945 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG dbcounter [-] [88550] Writing DB stats keystone:SELECT=100 {{(pid=88550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:06:37.356629 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7f38d45-57eb-420a-9dec-5e7bc009511c None admin] Validating token access rules against request {{(pid=88550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:06:37.358772 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a766f830-8bee-4de9-8964-8913ab30362d None admin] Validating token access rules against request {{(pid=88551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:06:37.391864 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0f165e0-5003-4ea6-bc5c-23404856037f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '819d41a279e64291acc60de51e1530ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:06:37.392092 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-080e419a-e1f1-417d-a219-bd09e401f3d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '819d41a279e64291acc60de51e1530ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:06:37.392456 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f165e0-5003-4ea6-bc5c-23404856037f None admin] REQUEST_METHOD: `GET` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:06:37.392575 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-080e419a-e1f1-417d-a219-bd09e401f3d7 None admin] REQUEST_METHOD: `GET` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:06:37.392731 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f165e0-5003-4ea6-bc5c-23404856037f None admin] SCRIPT_NAME: `/identity` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:06:37.392859 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-080e419a-e1f1-417d-a219-bd09e401f3d7 None admin] SCRIPT_NAME: `/identity` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:06:37.393000 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f165e0-5003-4ea6-bc5c-23404856037f None admin] PATH_INFO: `/v3/domains` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:06:37.393136 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-080e419a-e1f1-417d-a219-bd09e401f3d7 None admin] PATH_INFO: `/v3/domains` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:06:37.393626 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0f165e0-5003-4ea6-bc5c-23404856037f None admin] RBAC: Adding query filter params (name=Default) {{(pid=88551) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 19:06:37.393775 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-080e419a-e1f1-417d-a219-bd09e401f3d7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88550) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 19:06:37.393923 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0f165e0-5003-4ea6-bc5c-23404856037f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:06:37.394067 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-080e419a-e1f1-417d-a219-bd09e401f3d7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:06:37.395303 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0f165e0-5003-4ea6-bc5c-23404856037f None admin] RBAC: Authorization granted {{(pid=88551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:06:37.395456 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-080e419a-e1f1-417d-a219-bd09e401f3d7 None admin] RBAC: Authorization granted {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:06:37.407128 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: [pid: 88551|app: 0|req: 299/612] 10.222.0.26 () {56 vars in 1109 bytes} [Wed Aug 17 19:06:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 19:06:37.407564 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: [pid: 88550|app: 0|req: 314/613] 10.222.0.26 () {56 vars in 1109 bytes} [Wed Aug 17 19:06:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 19:06:37.407922 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0f165e0-5003-4ea6-bc5c-23404856037f None admin] Authenticating user token {{(pid=88551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:06:37.408510 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-080e419a-e1f1-417d-a219-bd09e401f3d7 None admin] Authenticating user token {{(pid=88550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:06:37.497925 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG dbcounter [-] [88551] Writing DB stats keystone:SELECT=100 {{(pid=88551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:06:37.507534 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0f165e0-5003-4ea6-bc5c-23404856037f None admin] Validating token access rules against request {{(pid=88551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:06:37.508377 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-080e419a-e1f1-417d-a219-bd09e401f3d7 None admin] Validating token access rules against request {{(pid=88550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:06:37.533933 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG dbcounter [-] [88550] Writing DB stats keystone:SELECT=100 {{(pid=88550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:06:37.542440 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8d65522-2809-4a56-ab9d-d56b8d04a1c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '819d41a279e64291acc60de51e1530ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:06:37.542631 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42224dc8-0b03-41db-995d-69a39c9d848e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '819d41a279e64291acc60de51e1530ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:06:37.543077 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d65522-2809-4a56-ab9d-d56b8d04a1c9 None admin] REQUEST_METHOD: `GET` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:06:37.543177 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42224dc8-0b03-41db-995d-69a39c9d848e None admin] REQUEST_METHOD: `GET` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:06:37.543358 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d65522-2809-4a56-ab9d-d56b8d04a1c9 None admin] SCRIPT_NAME: `/identity` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:06:37.543450 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42224dc8-0b03-41db-995d-69a39c9d848e None admin] SCRIPT_NAME: `/identity` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:06:37.543623 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d65522-2809-4a56-ab9d-d56b8d04a1c9 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:06:37.543713 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42224dc8-0b03-41db-995d-69a39c9d848e None admin] PATH_INFO: `/v3/users` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:06:37.544426 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42224dc8-0b03-41db-995d-69a39c9d848e None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=88550) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 19:06:37.544762 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42224dc8-0b03-41db-995d-69a39c9d848e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:06:37.546203 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42224dc8-0b03-41db-995d-69a39c9d848e None admin] RBAC: Authorization granted {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:06:37.550929 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8d65522-2809-4a56-ab9d-d56b8d04a1c9 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=88551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:06:37.552333 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8d65522-2809-4a56-ab9d-d56b8d04a1c9 None admin] RBAC: Authorization granted {{(pid=88551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:06:37.563138 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: [pid: 88550|app: 0|req: 315/614] 10.222.0.26 () {56 vars in 1137 bytes} [Wed Aug 17 19:06:37 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 19:06:37.563860 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application [None req-f8d65522-2809-4a56-ab9d-d56b8d04a1c9 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Aug 17 19:06:37.563860 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 19:06:37.563860 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 19:06:37.563860 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 19:06:37.563860 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 19:06:37.563860 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 19:06:37.563860 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 19:06:37.563860 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 19:06:37.563860 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 19:06:37.563860 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 19:06:37.563860 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 19:06:37.563860 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 19:06:37.563860 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 17 19:06:37.563860 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 17 19:06:37.563860 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 17 19:06:37.563860 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 17 19:06:37.565158 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 19:06:37.565158 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 19:06:37.565158 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 17 19:06:37.565158 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 17 19:06:37.565158 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 17 19:06:37.565158 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 17 19:06:37.565158 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 19:06:37.565158 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 19:06:37.565158 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 19:06:37.565158 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 19:06:37.565158 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 19:06:37.565158 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application with Lock( Aug 17 19:06:37.565158 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 19:06:37.565158 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application return self._enter() Aug 17 19:06:37.565158 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 19:06:37.565158 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 19:06:37.565158 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 19:06:37.565158 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application return self.creator() Aug 17 19:06:37.566634 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 19:06:37.566634 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application created_value = creator( Aug 17 19:06:37.566634 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 17 19:06:37.566634 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 17 19:06:37.566634 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 17 19:06:37.566634 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 17 19:06:37.566634 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 17 19:06:37.566634 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 17 19:06:37.566634 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Aug 17 19:06:37.566634 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application Aug 17 19:06:37.567196 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42224dc8-0b03-41db-995d-69a39c9d848e None admin] Authenticating user token {{(pid=88550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:06:37.567286 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: [pid: 88551|app: 0|req: 300/615] 10.222.0.26 () {56 vars in 1099 bytes} [Wed Aug 17 19:06:37 2022] GET /identity/v3/users/cinder => generated 84 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 19:06:37.567286 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8d65522-2809-4a56-ab9d-d56b8d04a1c9 None admin] Authenticating user token {{(pid=88551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:06:37.666163 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8d65522-2809-4a56-ab9d-d56b8d04a1c9 None admin] Validating token access rules against request {{(pid=88551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:06:37.667692 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42224dc8-0b03-41db-995d-69a39c9d848e None admin] Validating token access rules against request {{(pid=88550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:06:37.699840 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3a7a3df-c133-4077-860f-4e2956decbc3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '819d41a279e64291acc60de51e1530ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:06:37.700456 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a7a3df-c133-4077-860f-4e2956decbc3 None admin] REQUEST_METHOD: `GET` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:06:37.700734 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a7a3df-c133-4077-860f-4e2956decbc3 None admin] SCRIPT_NAME: `/identity` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:06:37.701493 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a7a3df-c133-4077-860f-4e2956decbc3 None admin] PATH_INFO: `/v3/projects/service` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:06:37.701785 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-831f8cec-1ffd-438b-8087-b07d24849a58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '819d41a279e64291acc60de51e1530ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:06:37.702405 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831f8cec-1ffd-438b-8087-b07d24849a58 None admin] REQUEST_METHOD: `GET` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:06:37.702716 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831f8cec-1ffd-438b-8087-b07d24849a58 None admin] SCRIPT_NAME: `/identity` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:06:37.702991 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831f8cec-1ffd-438b-8087-b07d24849a58 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:06:37.708091 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3a7a3df-c133-4077-860f-4e2956decbc3 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:06:37.709529 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3a7a3df-c133-4077-860f-4e2956decbc3 None admin] RBAC: Authorization granted {{(pid=88551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:06:37.709898 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-831f8cec-1ffd-438b-8087-b07d24849a58 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:06:37.711355 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-831f8cec-1ffd-438b-8087-b07d24849a58 None admin] RBAC: Authorization granted {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:06:37.721311 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application [None req-a3a7a3df-c133-4077-860f-4e2956decbc3 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 17 19:06:37.721311 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 19:06:37.721311 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 19:06:37.721311 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 19:06:37.721311 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 19:06:37.721311 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 19:06:37.721311 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 19:06:37.721311 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 19:06:37.721311 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 19:06:37.721311 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 19:06:37.721311 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 19:06:37.721311 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 19:06:37.721311 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 17 19:06:37.721311 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 17 19:06:37.721311 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 17 19:06:37.722361 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 17 19:06:37.722361 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 19:06:37.722361 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 19:06:37.722361 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 19:06:37.722361 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 19:06:37.722361 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 19:06:37.722361 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 19:06:37.722361 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 19:06:37.722361 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application with Lock( Aug 17 19:06:37.722361 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 19:06:37.722361 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application return self._enter() Aug 17 19:06:37.722361 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 19:06:37.722361 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 19:06:37.722361 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 19:06:37.722361 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application return self.creator() Aug 17 19:06:37.722361 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 19:06:37.722361 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application created_value = creator( Aug 17 19:06:37.723374 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 17 19:06:37.723374 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 17 19:06:37.723374 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 17 19:06:37.723374 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 17 19:06:37.723374 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 17 19:06:37.723374 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 17 19:06:37.723374 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 17 19:06:37.723374 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application Aug 17 19:06:37.723374 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: [pid: 88551|app: 0|req: 301/616] 10.222.0.26 () {56 vars in 1111 bytes} [Wed Aug 17 19:06:37 2022] GET /identity/v3/projects/service => generated 88 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 19:06:37.723870 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application [None req-831f8cec-1ffd-438b-8087-b07d24849a58 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Aug 17 19:06:37.723870 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 19:06:37.723870 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 19:06:37.723870 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 19:06:37.723870 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 19:06:37.723870 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 19:06:37.723870 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 19:06:37.723870 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 19:06:37.723870 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 19:06:37.723870 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 19:06:37.723870 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 19:06:37.723870 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 19:06:37.723870 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 17 19:06:37.723870 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 17 19:06:37.723870 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 17 19:06:37.723870 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 17 19:06:37.725049 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 19:06:37.725049 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 19:06:37.725049 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 17 19:06:37.725049 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 17 19:06:37.725049 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 17 19:06:37.725049 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 17 19:06:37.725049 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 19:06:37.725049 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 19:06:37.725049 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 19:06:37.725049 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 19:06:37.725049 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 19:06:37.725049 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application with Lock( Aug 17 19:06:37.725049 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 19:06:37.725049 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return self._enter() Aug 17 19:06:37.725049 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 19:06:37.725049 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 19:06:37.725049 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 19:06:37.725049 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return self.creator() Aug 17 19:06:37.726003 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 19:06:37.726003 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application created_value = creator( Aug 17 19:06:37.726003 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 17 19:06:37.726003 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 17 19:06:37.726003 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 17 19:06:37.726003 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 17 19:06:37.726003 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 17 19:06:37.726003 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 17 19:06:37.726003 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Aug 17 19:06:37.726003 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application Aug 17 19:06:37.726565 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3a7a3df-c133-4077-860f-4e2956decbc3 None admin] Authenticating user token {{(pid=88551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:06:37.726653 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: [pid: 88550|app: 0|req: 316/617] 10.222.0.26 () {56 vars in 1102 bytes} [Wed Aug 17 19:06:37 2022] GET /identity/v3/users/neutron => generated 85 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 19:06:37.726653 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-831f8cec-1ffd-438b-8087-b07d24849a58 None admin] Authenticating user token {{(pid=88550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:06:37.738022 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG dbcounter [-] [88551] Writing DB stats keystone:SELECT=100 {{(pid=88551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:06:37.776150 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG dbcounter [-] [88550] Writing DB stats keystone:SELECT=100 {{(pid=88550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:06:37.827926 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3a7a3df-c133-4077-860f-4e2956decbc3 None admin] Validating token access rules against request {{(pid=88551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:06:37.831827 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-831f8cec-1ffd-438b-8087-b07d24849a58 None admin] Validating token access rules against request {{(pid=88550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:06:37.861240 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f481171f-5c99-41e2-bb7b-6fd0860a8b97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '819d41a279e64291acc60de51e1530ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:06:37.861853 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f481171f-5c99-41e2-bb7b-6fd0860a8b97 None admin] REQUEST_METHOD: `GET` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:06:37.862131 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f481171f-5c99-41e2-bb7b-6fd0860a8b97 None admin] SCRIPT_NAME: `/identity` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:06:37.862404 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f481171f-5c99-41e2-bb7b-6fd0860a8b97 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:06:37.864701 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f93611a8-824b-4621-b90d-5b1f98b8f2b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '819d41a279e64291acc60de51e1530ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:06:37.865299 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f93611a8-824b-4621-b90d-5b1f98b8f2b6 None admin] REQUEST_METHOD: `GET` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:06:37.865575 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f93611a8-824b-4621-b90d-5b1f98b8f2b6 None admin] SCRIPT_NAME: `/identity` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:06:37.865850 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f93611a8-824b-4621-b90d-5b1f98b8f2b6 None admin] PATH_INFO: `/v3/users` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:06:37.866588 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f93611a8-824b-4621-b90d-5b1f98b8f2b6 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=88550) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 19:06:37.866901 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f93611a8-824b-4621-b90d-5b1f98b8f2b6 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:06:37.868317 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f93611a8-824b-4621-b90d-5b1f98b8f2b6 None admin] RBAC: Authorization granted {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:06:37.885451 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: [pid: 88550|app: 0|req: 317/618] 10.222.0.26 () {56 vars in 1137 bytes} [Wed Aug 17 19:06:37 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 19:06:37.886268 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f93611a8-824b-4621-b90d-5b1f98b8f2b6 None admin] Authenticating user token {{(pid=88550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:06:37.932819 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f481171f-5c99-41e2-bb7b-6fd0860a8b97 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:06:37.934295 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f481171f-5c99-41e2-bb7b-6fd0860a8b97 None admin] RBAC: Authorization granted {{(pid=88551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:06:37.949718 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG dbcounter [-] [88551] Writing DB stats keystone:SELECT=100 {{(pid=88551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:06:37.988554 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f93611a8-824b-4621-b90d-5b1f98b8f2b6 None admin] Validating token access rules against request {{(pid=88550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:06:37.990100 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG dbcounter [-] [88550] Writing DB stats keystone:SELECT=100 {{(pid=88550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:06:38.023361 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15f14a7e-bc4e-42c0-b2db-4eb5122aca91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '819d41a279e64291acc60de51e1530ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:06:38.024353 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f14a7e-bc4e-42c0-b2db-4eb5122aca91 None admin] REQUEST_METHOD: `GET` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:06:38.024653 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f14a7e-bc4e-42c0-b2db-4eb5122aca91 None admin] SCRIPT_NAME: `/identity` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:06:38.024955 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f14a7e-bc4e-42c0-b2db-4eb5122aca91 None admin] PATH_INFO: `/v3/users` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:06:38.025687 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15f14a7e-bc4e-42c0-b2db-4eb5122aca91 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=88550) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 19:06:38.025995 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15f14a7e-bc4e-42c0-b2db-4eb5122aca91 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:06:38.027994 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15f14a7e-bc4e-42c0-b2db-4eb5122aca91 None admin] RBAC: Authorization granted {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:06:38.038707 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: [pid: 88551|app: 0|req: 302/619] 10.222.0.26 () {58 vars in 1282 bytes} [Wed Aug 17 19:06:37 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 315 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 17 19:06:38.039572 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f481171f-5c99-41e2-bb7b-6fd0860a8b97 None admin] Authenticating user token {{(pid=88551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:06:38.051031 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: [pid: 88550|app: 0|req: 318/620] 10.222.0.26 () {56 vars in 1139 bytes} [Wed Aug 17 19:06:37 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 19:06:38.051031 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15f14a7e-bc4e-42c0-b2db-4eb5122aca91 None admin] Authenticating user token {{(pid=88550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:06:38.140280 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f481171f-5c99-41e2-bb7b-6fd0860a8b97 None admin] Validating token access rules against request {{(pid=88551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:06:38.145725 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15f14a7e-bc4e-42c0-b2db-4eb5122aca91 None admin] Validating token access rules against request {{(pid=88550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:06:38.150930 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG dbcounter [-] [88551] Writing DB stats keystone:SELECT=100 {{(pid=88551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:06:38.179144 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c17f348a-4d33-472d-bb7f-0fc398fa571b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '819d41a279e64291acc60de51e1530ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:06:38.179720 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c17f348a-4d33-472d-bb7f-0fc398fa571b None admin] REQUEST_METHOD: `GET` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:06:38.179995 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c17f348a-4d33-472d-bb7f-0fc398fa571b None admin] SCRIPT_NAME: `/identity` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:06:38.180264 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c17f348a-4d33-472d-bb7f-0fc398fa571b None admin] PATH_INFO: `/v3/projects` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:06:38.180784 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-559e157e-5a34-49e6-bf36-6c1562d794cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '819d41a279e64291acc60de51e1530ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:06:38.180940 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c17f348a-4d33-472d-bb7f-0fc398fa571b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88551) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 19:06:38.181240 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c17f348a-4d33-472d-bb7f-0fc398fa571b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:06:38.181387 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-559e157e-5a34-49e6-bf36-6c1562d794cb None admin] REQUEST_METHOD: `GET` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:06:38.181668 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-559e157e-5a34-49e6-bf36-6c1562d794cb None admin] SCRIPT_NAME: `/identity` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:06:38.181941 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-559e157e-5a34-49e6-bf36-6c1562d794cb None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:06:38.182673 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c17f348a-4d33-472d-bb7f-0fc398fa571b None admin] RBAC: Authorization granted {{(pid=88551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:06:38.199405 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: [pid: 88551|app: 0|req: 303/621] 10.222.0.26 () {56 vars in 1148 bytes} [Wed Aug 17 19:06:38 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 19:06:38.200327 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c17f348a-4d33-472d-bb7f-0fc398fa571b None admin] Authenticating user token {{(pid=88551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:06:38.219342 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG dbcounter [-] [88550] Writing DB stats keystone:SELECT=100 {{(pid=88550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:06:38.258746 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-559e157e-5a34-49e6-bf36-6c1562d794cb None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:06:38.260213 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-559e157e-5a34-49e6-bf36-6c1562d794cb None admin] RBAC: Authorization granted {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:06:38.315899 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c17f348a-4d33-472d-bb7f-0fc398fa571b None admin] Validating token access rules against request {{(pid=88551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:06:38.349459 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3efa4956-b75f-48f7-a864-9c81340dd85e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '819d41a279e64291acc60de51e1530ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:06:38.350072 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3efa4956-b75f-48f7-a864-9c81340dd85e None admin] REQUEST_METHOD: `GET` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:06:38.350354 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3efa4956-b75f-48f7-a864-9c81340dd85e None admin] SCRIPT_NAME: `/identity` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:06:38.350657 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3efa4956-b75f-48f7-a864-9c81340dd85e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:06:38.361116 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: [pid: 88550|app: 0|req: 319/622] 10.222.0.26 () {58 vars in 1282 bytes} [Wed Aug 17 19:06:38 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 314 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 17 19:06:38.361435 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3efa4956-b75f-48f7-a864-9c81340dd85e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:06:38.361944 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-559e157e-5a34-49e6-bf36-6c1562d794cb None admin] Authenticating user token {{(pid=88550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:06:38.362946 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3efa4956-b75f-48f7-a864-9c81340dd85e None admin] RBAC: Authorization granted {{(pid=88551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:06:38.378526 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application [None req-3efa4956-b75f-48f7-a864-9c81340dd85e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 19:06:38.378526 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 19:06:38.378526 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 19:06:38.378526 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 19:06:38.378526 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 19:06:38.378526 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 19:06:38.378526 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 19:06:38.378526 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 19:06:38.378526 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 19:06:38.378526 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 19:06:38.378526 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 19:06:38.378526 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 19:06:38.378526 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 17 19:06:38.378526 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 17 19:06:38.378526 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 17 19:06:38.378526 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 17 19:06:38.379562 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 19:06:38.379562 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 19:06:38.379562 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 19:06:38.379562 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 19:06:38.379562 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 19:06:38.379562 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 19:06:38.379562 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 19:06:38.379562 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application with Lock( Aug 17 19:06:38.379562 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 19:06:38.379562 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application return self._enter() Aug 17 19:06:38.379562 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 19:06:38.379562 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 19:06:38.379562 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 19:06:38.379562 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application return self.creator() Aug 17 19:06:38.379562 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 19:06:38.379562 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application created_value = creator( Aug 17 19:06:38.379562 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 17 19:06:38.380737 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 17 19:06:38.380737 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 19:06:38.380737 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application Aug 17 19:06:38.380737 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: [pid: 88551|app: 0|req: 304/623] 10.222.0.26 () {56 vars in 1108 bytes} [Wed Aug 17 19:06:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 19:06:38.380737 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3efa4956-b75f-48f7-a864-9c81340dd85e None admin] Authenticating user token {{(pid=88551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:06:38.406245 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG dbcounter [-] [88551] Writing DB stats keystone:SELECT=100 {{(pid=88551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:06:38.425125 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG dbcounter [-] [88550] Writing DB stats keystone:SELECT=100 {{(pid=88550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:06:38.465240 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-559e157e-5a34-49e6-bf36-6c1562d794cb None admin] Validating token access rules against request {{(pid=88550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:06:38.481251 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3efa4956-b75f-48f7-a864-9c81340dd85e None admin] Validating token access rules against request {{(pid=88551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:06:38.502214 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4633e283-c49a-4595-bcd3-9372eddb00c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '819d41a279e64291acc60de51e1530ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:06:38.502847 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4633e283-c49a-4595-bcd3-9372eddb00c2 None admin] REQUEST_METHOD: `GET` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:06:38.503120 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4633e283-c49a-4595-bcd3-9372eddb00c2 None admin] SCRIPT_NAME: `/identity` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:06:38.503389 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4633e283-c49a-4595-bcd3-9372eddb00c2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:06:38.515529 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c144628-4a48-41ff-86c6-4b8ed050b5ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '819d41a279e64291acc60de51e1530ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:06:38.516140 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c144628-4a48-41ff-86c6-4b8ed050b5ce None admin] REQUEST_METHOD: `GET` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:06:38.516407 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c144628-4a48-41ff-86c6-4b8ed050b5ce None admin] SCRIPT_NAME: `/identity` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:06:38.516679 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c144628-4a48-41ff-86c6-4b8ed050b5ce None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:06:38.517399 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c144628-4a48-41ff-86c6-4b8ed050b5ce None admin] RBAC: Adding query filter params (role.id=c798e3cf305b42dc8579aac6f3229a4b, scope.project.id=4bbf6c5abd684d899d09a08b0847d81c, user.id=9ae23e7a10d54989a25c9f3019184d01) {{(pid=88551) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 19:06:38.517709 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c144628-4a48-41ff-86c6-4b8ed050b5ce None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:06:38.519248 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c144628-4a48-41ff-86c6-4b8ed050b5ce None admin] RBAC: Authorization granted {{(pid=88551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:06:38.525438 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: [pid: 88551|app: 0|req: 305/624] 10.222.0.26 () {56 vars in 1374 bytes} [Wed Aug 17 19:06:38 2022] GET /identity/v3/role_assignments?user.id=9ae23e7a10d54989a25c9f3019184d01&scope.project.id=4bbf6c5abd684d899d09a08b0847d81c&role.id=c798e3cf305b42dc8579aac6f3229a4b => generated 608 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 19:06:38.526241 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c144628-4a48-41ff-86c6-4b8ed050b5ce None admin] Authenticating user token {{(pid=88551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:06:38.580129 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4633e283-c49a-4595-bcd3-9372eddb00c2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:06:38.581160 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4633e283-c49a-4595-bcd3-9372eddb00c2 None admin] RBAC: Authorization granted {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:06:38.633572 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG dbcounter [-] [88551] Writing DB stats keystone:SELECT=100 {{(pid=88551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:06:38.646471 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG dbcounter [-] [88550] Writing DB stats keystone:SELECT=100 {{(pid=88550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:06:38.651053 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c144628-4a48-41ff-86c6-4b8ed050b5ce None admin] Validating token access rules against request {{(pid=88551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:06:38.690962 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89b8f0f0-40e2-4f36-bfd8-242439cccb5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '819d41a279e64291acc60de51e1530ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:06:38.692355 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b8f0f0-40e2-4f36-bfd8-242439cccb5f None admin] REQUEST_METHOD: `GET` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:06:38.692636 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b8f0f0-40e2-4f36-bfd8-242439cccb5f None admin] SCRIPT_NAME: `/identity` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:06:38.692916 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b8f0f0-40e2-4f36-bfd8-242439cccb5f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:06:38.696580 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: [pid: 88550|app: 0|req: 320/625] 10.222.0.26 () {58 vars in 1282 bytes} [Wed Aug 17 19:06:38 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 335 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 17 19:06:38.697942 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4633e283-c49a-4595-bcd3-9372eddb00c2 None admin] Authenticating user token {{(pid=88550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:06:38.709168 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89b8f0f0-40e2-4f36-bfd8-242439cccb5f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:06:38.710663 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89b8f0f0-40e2-4f36-bfd8-242439cccb5f None admin] RBAC: Authorization granted {{(pid=88551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:06:38.726350 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application [None req-89b8f0f0-40e2-4f36-bfd8-242439cccb5f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 19:06:38.726350 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 19:06:38.726350 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 19:06:38.726350 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 19:06:38.726350 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 19:06:38.726350 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 19:06:38.726350 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 19:06:38.726350 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 19:06:38.726350 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 19:06:38.726350 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 19:06:38.726350 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 19:06:38.726350 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 19:06:38.726350 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 17 19:06:38.726350 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 17 19:06:38.726350 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 17 19:06:38.726350 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 17 19:06:38.727546 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 19:06:38.727546 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 19:06:38.727546 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 19:06:38.727546 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 19:06:38.727546 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 19:06:38.727546 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 19:06:38.727546 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 19:06:38.727546 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application with Lock( Aug 17 19:06:38.727546 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 19:06:38.727546 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application return self._enter() Aug 17 19:06:38.727546 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 19:06:38.727546 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 19:06:38.727546 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 19:06:38.727546 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application return self.creator() Aug 17 19:06:38.727546 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 19:06:38.727546 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application created_value = creator( Aug 17 19:06:38.727546 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 17 19:06:38.728625 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 17 19:06:38.728625 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 19:06:38.728625 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application Aug 17 19:06:38.728625 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: [pid: 88551|app: 0|req: 306/626] 10.222.0.26 () {56 vars in 1108 bytes} [Wed Aug 17 19:06:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 19:06:38.728625 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89b8f0f0-40e2-4f36-bfd8-242439cccb5f None admin] Authenticating user token {{(pid=88551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:06:38.820366 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4633e283-c49a-4595-bcd3-9372eddb00c2 None admin] Validating token access rules against request {{(pid=88550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:06:38.853916 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89b8f0f0-40e2-4f36-bfd8-242439cccb5f None admin] Validating token access rules against request {{(pid=88551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:06:38.859549 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-145e07e6-f60f-4af0-900b-abfe3cd00626 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '819d41a279e64291acc60de51e1530ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:06:38.860165 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-145e07e6-f60f-4af0-900b-abfe3cd00626 None admin] REQUEST_METHOD: `GET` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:06:38.860435 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-145e07e6-f60f-4af0-900b-abfe3cd00626 None admin] SCRIPT_NAME: `/identity` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:06:38.860700 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-145e07e6-f60f-4af0-900b-abfe3cd00626 None admin] PATH_INFO: `/v3/domains` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:06:38.861338 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-145e07e6-f60f-4af0-900b-abfe3cd00626 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88550) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 19:06:38.861633 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-145e07e6-f60f-4af0-900b-abfe3cd00626 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:06:38.863457 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-145e07e6-f60f-4af0-900b-abfe3cd00626 None admin] RBAC: Authorization granted {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:06:38.876920 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: [pid: 88550|app: 0|req: 321/627] 10.222.0.26 () {56 vars in 1109 bytes} [Wed Aug 17 19:06:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 19:06:38.877908 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-145e07e6-f60f-4af0-900b-abfe3cd00626 None admin] Authenticating user token {{(pid=88550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:06:38.891743 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feafa845-fab2-4350-878b-918d7166c221 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '819d41a279e64291acc60de51e1530ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:06:38.892380 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feafa845-fab2-4350-878b-918d7166c221 None admin] REQUEST_METHOD: `GET` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:06:38.892662 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feafa845-fab2-4350-878b-918d7166c221 None admin] SCRIPT_NAME: `/identity` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:06:38.892933 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feafa845-fab2-4350-878b-918d7166c221 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:06:38.900648 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG dbcounter [-] [88551] Writing DB stats keystone:SELECT=100 {{(pid=88551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:06:38.902140 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG dbcounter [-] [88550] Writing DB stats keystone:SELECT=100 {{(pid=88550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:06:38.906177 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feafa845-fab2-4350-878b-918d7166c221 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:06:38.907687 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feafa845-fab2-4350-878b-918d7166c221 None admin] RBAC: Authorization granted {{(pid=88551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:06:38.924411 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application [None req-feafa845-fab2-4350-878b-918d7166c221 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 19:06:38.924411 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 19:06:38.924411 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 19:06:38.924411 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 19:06:38.924411 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 19:06:38.924411 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 19:06:38.924411 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 19:06:38.924411 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 19:06:38.924411 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 19:06:38.924411 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 19:06:38.924411 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 19:06:38.924411 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 19:06:38.924411 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 17 19:06:38.924411 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 17 19:06:38.924411 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 17 19:06:38.924411 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 17 19:06:38.925380 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 19:06:38.925380 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 19:06:38.925380 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 19:06:38.925380 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 19:06:38.925380 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 19:06:38.925380 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 19:06:38.925380 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 19:06:38.925380 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application with Lock( Aug 17 19:06:38.925380 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 19:06:38.925380 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application return self._enter() Aug 17 19:06:38.925380 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 19:06:38.925380 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 19:06:38.925380 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 19:06:38.925380 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application return self.creator() Aug 17 19:06:38.925380 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 19:06:38.925380 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application created_value = creator( Aug 17 19:06:38.925380 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 17 19:06:38.926288 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 17 19:06:38.926288 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 19:06:38.926288 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application Aug 17 19:06:38.926288 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: [pid: 88551|app: 0|req: 307/628] 10.222.0.26 () {56 vars in 1108 bytes} [Wed Aug 17 19:06:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 19:06:38.926516 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feafa845-fab2-4350-878b-918d7166c221 None admin] Authenticating user token {{(pid=88551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:06:38.997561 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-145e07e6-f60f-4af0-900b-abfe3cd00626 None admin] Validating token access rules against request {{(pid=88550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:06:39.034374 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-056ab999-45bc-4ff7-8ad0-a59127a4f0fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '819d41a279e64291acc60de51e1530ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:06:39.035276 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-056ab999-45bc-4ff7-8ad0-a59127a4f0fd None admin] REQUEST_METHOD: `GET` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:06:39.035561 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-056ab999-45bc-4ff7-8ad0-a59127a4f0fd None admin] SCRIPT_NAME: `/identity` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:06:39.035838 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-056ab999-45bc-4ff7-8ad0-a59127a4f0fd None admin] PATH_INFO: `/v3/domains` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:06:39.036489 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-056ab999-45bc-4ff7-8ad0-a59127a4f0fd None admin] RBAC: Adding query filter params (name=Default) {{(pid=88550) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 19:06:39.036794 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-056ab999-45bc-4ff7-8ad0-a59127a4f0fd None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:06:39.038171 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-056ab999-45bc-4ff7-8ad0-a59127a4f0fd None admin] RBAC: Authorization granted {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:06:39.051485 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: [pid: 88550|app: 0|req: 322/629] 10.222.0.26 () {56 vars in 1109 bytes} [Wed Aug 17 19:06:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 19:06:39.052315 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-056ab999-45bc-4ff7-8ad0-a59127a4f0fd None admin] Authenticating user token {{(pid=88550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:06:39.066720 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feafa845-fab2-4350-878b-918d7166c221 None admin] Validating token access rules against request {{(pid=88551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:06:39.115508 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41ab5199-7b9a-4f2a-99b1-2a65538c0a3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '819d41a279e64291acc60de51e1530ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:06:39.116500 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ab5199-7b9a-4f2a-99b1-2a65538c0a3f None admin] REQUEST_METHOD: `GET` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:06:39.116966 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ab5199-7b9a-4f2a-99b1-2a65538c0a3f None admin] SCRIPT_NAME: `/identity` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:06:39.117484 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ab5199-7b9a-4f2a-99b1-2a65538c0a3f None admin] PATH_INFO: `/v3/projects/service` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:06:39.124950 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41ab5199-7b9a-4f2a-99b1-2a65538c0a3f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:06:39.126679 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41ab5199-7b9a-4f2a-99b1-2a65538c0a3f None admin] RBAC: Authorization granted {{(pid=88551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:06:39.137178 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG dbcounter [-] [88550] Writing DB stats keystone:SELECT=100 {{(pid=88550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:06:39.138036 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application [None req-41ab5199-7b9a-4f2a-99b1-2a65538c0a3f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 17 19:06:39.138036 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 19:06:39.138036 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 19:06:39.138036 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 19:06:39.138036 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 19:06:39.138036 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 19:06:39.138036 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 19:06:39.138036 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 19:06:39.138036 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 19:06:39.138036 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 19:06:39.138036 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 19:06:39.138036 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 19:06:39.138036 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 17 19:06:39.138036 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 17 19:06:39.138036 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 17 19:06:39.139757 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 17 19:06:39.139757 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 19:06:39.139757 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 19:06:39.139757 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 19:06:39.139757 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 19:06:39.139757 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 19:06:39.139757 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 19:06:39.139757 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 19:06:39.139757 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application with Lock( Aug 17 19:06:39.139757 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 19:06:39.139757 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application return self._enter() Aug 17 19:06:39.139757 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 19:06:39.139757 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 19:06:39.139757 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 19:06:39.139757 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application return self.creator() Aug 17 19:06:39.139757 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 19:06:39.139757 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application created_value = creator( Aug 17 19:06:39.141320 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 17 19:06:39.141320 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 17 19:06:39.141320 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 17 19:06:39.141320 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 17 19:06:39.141320 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 17 19:06:39.141320 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 17 19:06:39.141320 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 17 19:06:39.141320 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application Aug 17 19:06:39.141320 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: [pid: 88551|app: 0|req: 308/630] 10.222.0.26 () {56 vars in 1111 bytes} [Wed Aug 17 19:06:38 2022] GET /identity/v3/projects/service => generated 88 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 19:06:39.141320 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41ab5199-7b9a-4f2a-99b1-2a65538c0a3f None admin] Authenticating user token {{(pid=88551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:06:39.164764 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-056ab999-45bc-4ff7-8ad0-a59127a4f0fd None admin] Validating token access rules against request {{(pid=88550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:06:39.197006 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG dbcounter [-] [88551] Writing DB stats keystone:SELECT=100 {{(pid=88551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:06:39.202739 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5d2e109-325b-45bd-bfbd-5ff63b815aeb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '819d41a279e64291acc60de51e1530ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:06:39.203346 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d2e109-325b-45bd-bfbd-5ff63b815aeb None admin] REQUEST_METHOD: `GET` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:06:39.203634 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d2e109-325b-45bd-bfbd-5ff63b815aeb None admin] SCRIPT_NAME: `/identity` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:06:39.203964 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d2e109-325b-45bd-bfbd-5ff63b815aeb None admin] PATH_INFO: `/v3/domains` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:06:39.204608 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5d2e109-325b-45bd-bfbd-5ff63b815aeb None admin] RBAC: Adding query filter params (name=Default) {{(pid=88550) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 19:06:39.204912 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5d2e109-325b-45bd-bfbd-5ff63b815aeb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:06:39.206289 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5d2e109-325b-45bd-bfbd-5ff63b815aeb None admin] RBAC: Authorization granted {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:06:39.218772 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: [pid: 88550|app: 0|req: 323/631] 10.222.0.26 () {56 vars in 1109 bytes} [Wed Aug 17 19:06:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 19:06:39.219591 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5d2e109-325b-45bd-bfbd-5ff63b815aeb None admin] Authenticating user token {{(pid=88550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:06:39.254002 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41ab5199-7b9a-4f2a-99b1-2a65538c0a3f None admin] Validating token access rules against request {{(pid=88551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:06:39.294395 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-417eeef1-6949-42ff-8e8c-7d7b56dfec50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '819d41a279e64291acc60de51e1530ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:06:39.295873 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-417eeef1-6949-42ff-8e8c-7d7b56dfec50 None admin] REQUEST_METHOD: `GET` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:06:39.296160 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-417eeef1-6949-42ff-8e8c-7d7b56dfec50 None admin] SCRIPT_NAME: `/identity` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:06:39.296437 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-417eeef1-6949-42ff-8e8c-7d7b56dfec50 None admin] PATH_INFO: `/v3/projects/service` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:06:39.303764 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-417eeef1-6949-42ff-8e8c-7d7b56dfec50 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:06:39.305236 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-417eeef1-6949-42ff-8e8c-7d7b56dfec50 None admin] RBAC: Authorization granted {{(pid=88551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:06:39.318932 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application [None req-417eeef1-6949-42ff-8e8c-7d7b56dfec50 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 17 19:06:39.318932 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 19:06:39.318932 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 19:06:39.318932 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 19:06:39.318932 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 19:06:39.318932 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 19:06:39.318932 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 19:06:39.318932 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 19:06:39.318932 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 19:06:39.318932 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 19:06:39.318932 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 19:06:39.318932 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 19:06:39.318932 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 17 19:06:39.318932 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 17 19:06:39.318932 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 17 19:06:39.319994 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 17 19:06:39.319994 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 19:06:39.319994 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 19:06:39.319994 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 19:06:39.319994 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 19:06:39.319994 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 19:06:39.319994 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 19:06:39.319994 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 19:06:39.319994 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application with Lock( Aug 17 19:06:39.319994 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 19:06:39.319994 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application return self._enter() Aug 17 19:06:39.319994 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 19:06:39.319994 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 19:06:39.319994 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 19:06:39.319994 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application return self.creator() Aug 17 19:06:39.319994 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 19:06:39.319994 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application created_value = creator( Aug 17 19:06:39.320957 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 17 19:06:39.320957 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 17 19:06:39.320957 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 17 19:06:39.320957 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 17 19:06:39.320957 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 17 19:06:39.320957 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 17 19:06:39.320957 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 17 19:06:39.320957 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application Aug 17 19:06:39.320957 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: [pid: 88551|app: 0|req: 309/632] 10.222.0.26 () {56 vars in 1111 bytes} [Wed Aug 17 19:06:39 2022] GET /identity/v3/projects/service => generated 88 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 19:06:39.321459 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-417eeef1-6949-42ff-8e8c-7d7b56dfec50 None admin] Authenticating user token {{(pid=88551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:06:39.335751 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5d2e109-325b-45bd-bfbd-5ff63b815aeb None admin] Validating token access rules against request {{(pid=88550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:06:39.379608 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1299ff86-3315-40c3-8c16-d2dae793fb7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '819d41a279e64291acc60de51e1530ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:06:39.380124 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1299ff86-3315-40c3-8c16-d2dae793fb7f None admin] REQUEST_METHOD: `GET` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:06:39.380401 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1299ff86-3315-40c3-8c16-d2dae793fb7f None admin] SCRIPT_NAME: `/identity` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:06:39.380676 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1299ff86-3315-40c3-8c16-d2dae793fb7f None admin] PATH_INFO: `/v3/projects` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:06:39.381367 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1299ff86-3315-40c3-8c16-d2dae793fb7f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88550) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 19:06:39.381676 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1299ff86-3315-40c3-8c16-d2dae793fb7f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:06:39.383150 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1299ff86-3315-40c3-8c16-d2dae793fb7f None admin] RBAC: Authorization granted {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:06:39.392462 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG dbcounter [-] [88550] Writing DB stats keystone:SELECT=100 {{(pid=88550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:06:39.400651 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: [pid: 88550|app: 0|req: 324/633] 10.222.0.26 () {56 vars in 1148 bytes} [Wed Aug 17 19:06:39 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 19:06:39.400651 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1299ff86-3315-40c3-8c16-d2dae793fb7f None admin] Authenticating user token {{(pid=88550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:06:39.448512 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-417eeef1-6949-42ff-8e8c-7d7b56dfec50 None admin] Validating token access rules against request {{(pid=88551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:06:39.459910 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG dbcounter [-] [88551] Writing DB stats keystone:SELECT=100 {{(pid=88551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:06:39.484330 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b715e324-fbf7-48b9-b8cc-91bc6018bfad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '819d41a279e64291acc60de51e1530ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:06:39.484954 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b715e324-fbf7-48b9-b8cc-91bc6018bfad None admin] REQUEST_METHOD: `GET` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:06:39.485234 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b715e324-fbf7-48b9-b8cc-91bc6018bfad None admin] SCRIPT_NAME: `/identity` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:06:39.485506 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b715e324-fbf7-48b9-b8cc-91bc6018bfad None admin] PATH_INFO: `/v3/projects/service` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:06:39.493066 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b715e324-fbf7-48b9-b8cc-91bc6018bfad None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:06:39.494599 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b715e324-fbf7-48b9-b8cc-91bc6018bfad None admin] RBAC: Authorization granted {{(pid=88551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:06:39.507368 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application [None req-b715e324-fbf7-48b9-b8cc-91bc6018bfad None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 17 19:06:39.507368 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 19:06:39.507368 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 19:06:39.507368 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 19:06:39.507368 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 19:06:39.507368 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 19:06:39.507368 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 19:06:39.507368 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 19:06:39.507368 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 19:06:39.507368 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 19:06:39.507368 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 19:06:39.507368 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 19:06:39.507368 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 17 19:06:39.507368 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 17 19:06:39.507368 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 17 19:06:39.508559 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 17 19:06:39.508559 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 19:06:39.508559 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 19:06:39.508559 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 19:06:39.508559 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 19:06:39.508559 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 19:06:39.508559 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 19:06:39.508559 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 19:06:39.508559 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application with Lock( Aug 17 19:06:39.508559 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 19:06:39.508559 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application return self._enter() Aug 17 19:06:39.508559 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 19:06:39.508559 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 19:06:39.508559 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 19:06:39.508559 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application return self.creator() Aug 17 19:06:39.508559 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 19:06:39.508559 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application created_value = creator( Aug 17 19:06:39.509711 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 17 19:06:39.509711 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 17 19:06:39.509711 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 17 19:06:39.509711 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 17 19:06:39.509711 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 17 19:06:39.509711 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 17 19:06:39.509711 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 17 19:06:39.509711 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application Aug 17 19:06:39.509711 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: [pid: 88551|app: 0|req: 310/634] 10.222.0.26 () {56 vars in 1111 bytes} [Wed Aug 17 19:06:39 2022] GET /identity/v3/projects/service => generated 88 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 19:06:39.509711 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b715e324-fbf7-48b9-b8cc-91bc6018bfad None admin] Authenticating user token {{(pid=88551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:06:39.516044 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1299ff86-3315-40c3-8c16-d2dae793fb7f None admin] Validating token access rules against request {{(pid=88550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:06:39.551893 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d4c5a41-4089-4556-b7ec-c7eae1f51dd2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '819d41a279e64291acc60de51e1530ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:06:39.552504 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d4c5a41-4089-4556-b7ec-c7eae1f51dd2 None admin] REQUEST_METHOD: `GET` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:06:39.552783 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d4c5a41-4089-4556-b7ec-c7eae1f51dd2 None admin] SCRIPT_NAME: `/identity` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:06:39.553055 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d4c5a41-4089-4556-b7ec-c7eae1f51dd2 None admin] PATH_INFO: `/v3/projects` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:06:39.553773 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d4c5a41-4089-4556-b7ec-c7eae1f51dd2 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88550) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 19:06:39.554044 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d4c5a41-4089-4556-b7ec-c7eae1f51dd2 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:06:39.555513 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d4c5a41-4089-4556-b7ec-c7eae1f51dd2 None admin] RBAC: Authorization granted {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:06:39.568090 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: [pid: 88550|app: 0|req: 325/635] 10.222.0.26 () {56 vars in 1148 bytes} [Wed Aug 17 19:06:39 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 19:06:39.568090 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d4c5a41-4089-4556-b7ec-c7eae1f51dd2 None admin] Authenticating user token {{(pid=88550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:06:39.624305 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b715e324-fbf7-48b9-b8cc-91bc6018bfad None admin] Validating token access rules against request {{(pid=88551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:06:39.635270 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG dbcounter [-] [88550] Writing DB stats keystone:SELECT=100 {{(pid=88550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:06:39.665349 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-068fd6be-d96d-44d0-974f-c992b66270d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '819d41a279e64291acc60de51e1530ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:06:39.666175 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-068fd6be-d96d-44d0-974f-c992b66270d7 None admin] REQUEST_METHOD: `GET` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:06:39.666474 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-068fd6be-d96d-44d0-974f-c992b66270d7 None admin] SCRIPT_NAME: `/identity` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:06:39.667323 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-068fd6be-d96d-44d0-974f-c992b66270d7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:06:39.668365 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-068fd6be-d96d-44d0-974f-c992b66270d7 None admin] RBAC: Adding query filter params (role.id=c798e3cf305b42dc8579aac6f3229a4b, scope.project.id=4bbf6c5abd684d899d09a08b0847d81c, user.id=5f32f6111c1c4f1f86c2185bde99a368) {{(pid=88551) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 19:06:39.668709 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-068fd6be-d96d-44d0-974f-c992b66270d7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:06:39.671185 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-068fd6be-d96d-44d0-974f-c992b66270d7 None admin] RBAC: Authorization granted {{(pid=88551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:06:39.686582 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: [pid: 88551|app: 0|req: 311/636] 10.222.0.26 () {56 vars in 1374 bytes} [Wed Aug 17 19:06:39 2022] GET /identity/v3/role_assignments?user.id=5f32f6111c1c4f1f86c2185bde99a368&scope.project.id=4bbf6c5abd684d899d09a08b0847d81c&role.id=c798e3cf305b42dc8579aac6f3229a4b => generated 608 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 19:06:39.686841 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d4c5a41-4089-4556-b7ec-c7eae1f51dd2 None admin] Validating token access rules against request {{(pid=88550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:06:39.686951 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-068fd6be-d96d-44d0-974f-c992b66270d7 None admin] Authenticating user token {{(pid=88551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:06:39.722832 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36eaf2d8-3592-44bc-8c5e-a1ecc83113c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '819d41a279e64291acc60de51e1530ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:06:39.723492 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36eaf2d8-3592-44bc-8c5e-a1ecc83113c3 None admin] REQUEST_METHOD: `GET` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:06:39.725111 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36eaf2d8-3592-44bc-8c5e-a1ecc83113c3 None admin] SCRIPT_NAME: `/identity` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:06:39.725111 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36eaf2d8-3592-44bc-8c5e-a1ecc83113c3 None admin] PATH_INFO: `/v3/projects` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:06:39.725111 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36eaf2d8-3592-44bc-8c5e-a1ecc83113c3 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88550) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 19:06:39.725111 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36eaf2d8-3592-44bc-8c5e-a1ecc83113c3 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:06:39.726459 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36eaf2d8-3592-44bc-8c5e-a1ecc83113c3 None admin] RBAC: Authorization granted {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:06:39.741431 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: [pid: 88550|app: 0|req: 326/637] 10.222.0.26 () {56 vars in 1148 bytes} [Wed Aug 17 19:06:39 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 19:06:39.743680 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG dbcounter [-] [88551] Writing DB stats keystone:SELECT=100 {{(pid=88551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:06:39.747893 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36eaf2d8-3592-44bc-8c5e-a1ecc83113c3 None admin] Authenticating user token {{(pid=88550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:06:39.847378 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-068fd6be-d96d-44d0-974f-c992b66270d7 None admin] Validating token access rules against request {{(pid=88551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:06:39.890733 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4649301-90d5-42a7-b84c-d48da00da7eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '819d41a279e64291acc60de51e1530ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:06:39.891195 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4649301-90d5-42a7-b84c-d48da00da7eb None admin] REQUEST_METHOD: `GET` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:06:39.891496 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4649301-90d5-42a7-b84c-d48da00da7eb None admin] SCRIPT_NAME: `/identity` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:06:39.891749 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4649301-90d5-42a7-b84c-d48da00da7eb None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:06:39.892478 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4649301-90d5-42a7-b84c-d48da00da7eb None admin] RBAC: Adding query filter params (role.id=c798e3cf305b42dc8579aac6f3229a4b, scope.project.id=4bbf6c5abd684d899d09a08b0847d81c, user.id=0a7ec0aa480147f897f8a76b5b29f3c4) {{(pid=88551) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 19:06:39.892826 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4649301-90d5-42a7-b84c-d48da00da7eb None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:06:39.894251 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4649301-90d5-42a7-b84c-d48da00da7eb None admin] RBAC: Authorization granted {{(pid=88551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:06:39.900359 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36eaf2d8-3592-44bc-8c5e-a1ecc83113c3 None admin] Validating token access rules against request {{(pid=88550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:06:39.901582 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: [pid: 88551|app: 0|req: 312/638] 10.222.0.26 () {56 vars in 1374 bytes} [Wed Aug 17 19:06:39 2022] GET /identity/v3/role_assignments?user.id=0a7ec0aa480147f897f8a76b5b29f3c4&scope.project.id=4bbf6c5abd684d899d09a08b0847d81c&role.id=c798e3cf305b42dc8579aac6f3229a4b => generated 608 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 19:06:39.937697 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG dbcounter [-] [88550] Writing DB stats keystone:SELECT=100 {{(pid=88550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:06:39.949436 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42e66080-28ae-431a-b78e-6d99ed6c7667 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '819d41a279e64291acc60de51e1530ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:06:39.950053 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e66080-28ae-431a-b78e-6d99ed6c7667 None admin] REQUEST_METHOD: `GET` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:06:39.950333 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e66080-28ae-431a-b78e-6d99ed6c7667 None admin] SCRIPT_NAME: `/identity` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:06:39.950643 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e66080-28ae-431a-b78e-6d99ed6c7667 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:06:39.952132 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42e66080-28ae-431a-b78e-6d99ed6c7667 None admin] RBAC: Adding query filter params (role.id=c798e3cf305b42dc8579aac6f3229a4b, scope.project.id=4bbf6c5abd684d899d09a08b0847d81c, user.id=8240f6e0b65545708f07e040c09e1490) {{(pid=88550) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 19:06:39.952441 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42e66080-28ae-431a-b78e-6d99ed6c7667 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:06:39.953939 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42e66080-28ae-431a-b78e-6d99ed6c7667 None admin] RBAC: Authorization granted {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:06:39.962725 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: [pid: 88550|app: 0|req: 327/639] 10.222.0.26 () {56 vars in 1374 bytes} [Wed Aug 17 19:06:39 2022] GET /identity/v3/role_assignments?user.id=8240f6e0b65545708f07e040c09e1490&scope.project.id=4bbf6c5abd684d899d09a08b0847d81c&role.id=c798e3cf305b42dc8579aac6f3229a4b => generated 608 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 19:06:40.877169 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-699dec0d-fbaf-461b-9516-6c13c7ed5e7a None None] REQUEST_METHOD: `GET` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:06:40.877690 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-699dec0d-fbaf-461b-9516-6c13c7ed5e7a None None] SCRIPT_NAME: `/identity` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:06:40.877690 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-699dec0d-fbaf-461b-9516-6c13c7ed5e7a None None] PATH_INFO: `/` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:06:40.879300 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: [pid: 88551|app: 0|req: 313/640] 10.222.0.26 () {54 vars in 927 bytes} [Wed Aug 17 19:06:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 19:06:40.884390 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e29171-daf3-4f3c-847e-3b14951fda38 None None] REQUEST_METHOD: `POST` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:06:40.884789 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e29171-daf3-4f3c-847e-3b14951fda38 None None] SCRIPT_NAME: `/identity` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:06:40.884958 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e29171-daf3-4f3c-847e-3b14951fda38 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:06:40.903531 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.auth.core [None req-05e29171-daf3-4f3c-847e-3b14951fda38 None None] MFA Rules not processed for user `819d41a279e64291acc60de51e1530ae`. Rule list: `[]` (Enabled: `True`). {{(pid=88550) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 19:06:40.905239 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.common.fernet_utils [None req-05e29171-daf3-4f3c-847e-3b14951fda38 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:06:40.982228 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: [pid: 88550|app: 0|req: 328/641] 10.222.0.26 () {58 vars in 1024 bytes} [Wed Aug 17 19:06:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 17 19:06:41.310066 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-699dec0d-fbaf-461b-9516-6c13c7ed5e7a None None] Authenticating user token {{(pid=88551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:06:41.414775 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG dbcounter [-] [88551] Writing DB stats keystone:SELECT=100 {{(pid=88551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:06:41.419287 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-699dec0d-fbaf-461b-9516-6c13c7ed5e7a None None] Validating token access rules against request {{(pid=88551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:06:41.454886 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44271939-c0e3-4b08-8570-425231a4ee6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '819d41a279e64291acc60de51e1530ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:06:41.455512 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44271939-c0e3-4b08-8570-425231a4ee6d None admin] REQUEST_METHOD: `GET` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:06:41.455793 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44271939-c0e3-4b08-8570-425231a4ee6d None admin] SCRIPT_NAME: `/identity` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:06:41.456065 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44271939-c0e3-4b08-8570-425231a4ee6d None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:06:41.467035 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44271939-c0e3-4b08-8570-425231a4ee6d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 17 19:06:41.471671 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application [None req-44271939-c0e3-4b08-8570-425231a4ee6d None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 17 19:06:41.471671 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 19:06:41.471671 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 19:06:41.471671 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 19:06:41.471671 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 19:06:41.471671 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 19:06:41.471671 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 19:06:41.471671 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 19:06:41.471671 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 19:06:41.471671 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 19:06:41.471671 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 19:06:41.471671 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 19:06:41.471671 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 17 19:06:41.471671 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 17 19:06:41.471671 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 17 19:06:41.471671 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 17 19:06:41.472711 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 17 19:06:41.472711 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 17 19:06:41.472711 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 17 19:06:41.472711 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 17 19:06:41.472711 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 19:06:41.472711 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 19:06:41.472711 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 19:06:41.472711 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 19:06:41.472711 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 19:06:41.472711 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 19:06:41.472711 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 19:06:41.472711 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application with Lock( Aug 17 19:06:41.472711 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 19:06:41.472711 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application return self._enter() Aug 17 19:06:41.472711 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 19:06:41.472711 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 19:06:41.473644 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 19:06:41.473644 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application return self.creator() Aug 17 19:06:41.473644 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 19:06:41.473644 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application created_value = creator( Aug 17 19:06:41.473644 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 17 19:06:41.473644 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 17 19:06:41.473644 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 17 19:06:41.473644 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 17 19:06:41.473644 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 17 19:06:41.473644 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 17 19:06:41.473644 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 17 19:06:41.473644 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application Aug 17 19:06:41.473644 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: [pid: 88551|app: 0|req: 314/642] 10.222.0.26 () {56 vars in 1096 bytes} [Wed Aug 17 19:06:41 2022] GET /identity/v3/roles/admin => generated 83 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 19:06:41.479633 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05e29171-daf3-4f3c-847e-3b14951fda38 None None] Authenticating user token {{(pid=88550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:06:41.583674 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05e29171-daf3-4f3c-847e-3b14951fda38 None None] Validating token access rules against request {{(pid=88550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:06:41.599404 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG dbcounter [-] [88550] Writing DB stats keystone:SELECT=100 {{(pid=88550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:06:41.627124 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38aa884f-b6a3-4bb0-a82b-c1f7fd504d71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '819d41a279e64291acc60de51e1530ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:06:41.629007 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38aa884f-b6a3-4bb0-a82b-c1f7fd504d71 None admin] REQUEST_METHOD: `GET` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:06:41.629496 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38aa884f-b6a3-4bb0-a82b-c1f7fd504d71 None admin] SCRIPT_NAME: `/identity` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:06:41.629972 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38aa884f-b6a3-4bb0-a82b-c1f7fd504d71 None admin] PATH_INFO: `/v3/roles` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:06:41.630878 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38aa884f-b6a3-4bb0-a82b-c1f7fd504d71 None admin] RBAC: Adding query filter params (name=admin) {{(pid=88550) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 19:06:41.631389 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38aa884f-b6a3-4bb0-a82b-c1f7fd504d71 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:06:41.632977 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38aa884f-b6a3-4bb0-a82b-c1f7fd504d71 None admin] RBAC: Authorization granted {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:06:41.643115 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: [pid: 88550|app: 0|req: 329/643] 10.222.0.26 () {56 vars in 1099 bytes} [Wed Aug 17 19:06:41 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 19:06:41.650629 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44271939-c0e3-4b08-8570-425231a4ee6d None admin] Authenticating user token {{(pid=88551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:06:41.754411 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44271939-c0e3-4b08-8570-425231a4ee6d None admin] Validating token access rules against request {{(pid=88551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:06:41.789702 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d8960f7-4232-4cb3-bf51-98efa38377cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '819d41a279e64291acc60de51e1530ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:06:41.790322 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d8960f7-4232-4cb3-bf51-98efa38377cf None admin] REQUEST_METHOD: `GET` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:06:41.790629 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d8960f7-4232-4cb3-bf51-98efa38377cf None admin] SCRIPT_NAME: `/identity` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:06:41.790898 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d8960f7-4232-4cb3-bf51-98efa38377cf None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:06:41.802901 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d8960f7-4232-4cb3-bf51-98efa38377cf None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:06:41.804423 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d8960f7-4232-4cb3-bf51-98efa38377cf None admin] RBAC: Authorization granted {{(pid=88551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:06:41.819171 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application [None req-2d8960f7-4232-4cb3-bf51-98efa38377cf None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 19:06:41.819171 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 19:06:41.819171 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 19:06:41.819171 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 19:06:41.819171 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 19:06:41.819171 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 19:06:41.819171 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 19:06:41.819171 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 19:06:41.819171 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 19:06:41.819171 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 19:06:41.819171 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 19:06:41.819171 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 19:06:41.819171 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 17 19:06:41.819171 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 17 19:06:41.819171 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 17 19:06:41.819171 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 17 19:06:41.820193 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 19:06:41.820193 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 19:06:41.820193 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 19:06:41.820193 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 19:06:41.820193 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 19:06:41.820193 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 19:06:41.820193 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 19:06:41.820193 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application with Lock( Aug 17 19:06:41.820193 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 19:06:41.820193 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application return self._enter() Aug 17 19:06:41.820193 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 19:06:41.820193 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 19:06:41.820193 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 19:06:41.820193 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application return self.creator() Aug 17 19:06:41.820193 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 19:06:41.820193 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application created_value = creator( Aug 17 19:06:41.820193 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 17 19:06:41.821107 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 17 19:06:41.821107 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 19:06:41.821107 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application Aug 17 19:06:41.821107 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: [pid: 88551|app: 0|req: 315/644] 10.222.0.26 () {56 vars in 1108 bytes} [Wed Aug 17 19:06:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 19:06:41.826233 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38aa884f-b6a3-4bb0-a82b-c1f7fd504d71 None admin] Authenticating user token {{(pid=88550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:06:41.943702 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38aa884f-b6a3-4bb0-a82b-c1f7fd504d71 None admin] Validating token access rules against request {{(pid=88550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:06:41.985061 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77fe5f89-6e58-47b9-99bb-d5e5c29f34a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '819d41a279e64291acc60de51e1530ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:06:41.985694 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77fe5f89-6e58-47b9-99bb-d5e5c29f34a3 None admin] REQUEST_METHOD: `GET` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:06:41.985973 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77fe5f89-6e58-47b9-99bb-d5e5c29f34a3 None admin] SCRIPT_NAME: `/identity` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:06:41.986247 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77fe5f89-6e58-47b9-99bb-d5e5c29f34a3 None admin] PATH_INFO: `/v3/domains` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:06:41.986944 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77fe5f89-6e58-47b9-99bb-d5e5c29f34a3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88550) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 19:06:41.987248 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77fe5f89-6e58-47b9-99bb-d5e5c29f34a3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:06:41.988769 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77fe5f89-6e58-47b9-99bb-d5e5c29f34a3 None admin] RBAC: Authorization granted {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:06:42.002681 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: [pid: 88550|app: 0|req: 330/645] 10.222.0.26 () {56 vars in 1109 bytes} [Wed Aug 17 19:06:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 19:06:42.007691 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d8960f7-4232-4cb3-bf51-98efa38377cf None admin] Authenticating user token {{(pid=88551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:06:42.034918 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG dbcounter [-] [88551] Writing DB stats keystone:SELECT=100 {{(pid=88551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:06:42.118787 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d8960f7-4232-4cb3-bf51-98efa38377cf None admin] Validating token access rules against request {{(pid=88551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:06:42.135934 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10783f00-66fa-4b5e-a95c-3a8a1c3f04b6 None None] REQUEST_METHOD: `GET` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:06:42.136241 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10783f00-66fa-4b5e-a95c-3a8a1c3f04b6 None None] SCRIPT_NAME: `/identity` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:06:42.136489 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10783f00-66fa-4b5e-a95c-3a8a1c3f04b6 None None] PATH_INFO: `/` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:06:42.138142 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: [pid: 88550|app: 0|req: 331/646] 10.222.0.26 () {54 vars in 927 bytes} [Wed Aug 17 19:06:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 19:06:42.145852 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22aab1ab-982a-42a4-af8b-34177f60a596 None None] REQUEST_METHOD: `POST` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:06:42.146130 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22aab1ab-982a-42a4-af8b-34177f60a596 None None] SCRIPT_NAME: `/identity` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:06:42.146399 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22aab1ab-982a-42a4-af8b-34177f60a596 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:06:42.159773 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54e6e40d-22d4-459a-a245-91ce86afa117 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '819d41a279e64291acc60de51e1530ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:06:42.160623 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e6e40d-22d4-459a-a245-91ce86afa117 None admin] REQUEST_METHOD: `GET` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:06:42.161122 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e6e40d-22d4-459a-a245-91ce86afa117 None admin] SCRIPT_NAME: `/identity` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:06:42.161404 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e6e40d-22d4-459a-a245-91ce86afa117 None admin] PATH_INFO: `/v3/users/nova` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:06:42.165647 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.auth.core [None req-22aab1ab-982a-42a4-af8b-34177f60a596 None None] MFA Rules not processed for user `819d41a279e64291acc60de51e1530ae`. Rule list: `[]` (Enabled: `True`). {{(pid=88550) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 19:06:42.167135 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.common.fernet_utils [None req-22aab1ab-982a-42a4-af8b-34177f60a596 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:06:42.169084 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54e6e40d-22d4-459a-a245-91ce86afa117 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=88551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:06:42.170907 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54e6e40d-22d4-459a-a245-91ce86afa117 None admin] RBAC: Authorization granted {{(pid=88551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:06:42.183803 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application [None req-54e6e40d-22d4-459a-a245-91ce86afa117 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 17 19:06:42.183803 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 19:06:42.183803 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 19:06:42.183803 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 19:06:42.183803 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 19:06:42.183803 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 19:06:42.183803 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 19:06:42.183803 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 19:06:42.183803 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 19:06:42.183803 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 19:06:42.183803 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 19:06:42.183803 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 19:06:42.183803 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 17 19:06:42.183803 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 17 19:06:42.183803 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 17 19:06:42.183803 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 17 19:06:42.184808 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 19:06:42.184808 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 19:06:42.184808 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 17 19:06:42.184808 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 17 19:06:42.184808 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 17 19:06:42.184808 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 17 19:06:42.184808 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 19:06:42.184808 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 19:06:42.184808 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 19:06:42.184808 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 19:06:42.184808 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 19:06:42.184808 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application with Lock( Aug 17 19:06:42.184808 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 19:06:42.184808 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application return self._enter() Aug 17 19:06:42.184808 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 19:06:42.184808 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 19:06:42.184808 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 19:06:42.184808 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application return self.creator() Aug 17 19:06:42.186060 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 19:06:42.186060 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application created_value = creator( Aug 17 19:06:42.186060 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 17 19:06:42.186060 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 17 19:06:42.186060 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 17 19:06:42.186060 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 17 19:06:42.186060 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 17 19:06:42.186060 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 17 19:06:42.186060 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 17 19:06:42.186060 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application Aug 17 19:06:42.188228 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: [pid: 88551|app: 0|req: 316/647] 10.222.0.26 () {56 vars in 1093 bytes} [Wed Aug 17 19:06:42 2022] GET /identity/v3/users/nova => generated 82 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 19:06:42.193857 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54e6e40d-22d4-459a-a245-91ce86afa117 None admin] Authenticating user token {{(pid=88551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:06:42.199566 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG dbcounter [-] [88550] Writing DB stats keystone:SELECT=100 {{(pid=88550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:06:42.253343 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: [pid: 88550|app: 0|req: 332/648] 10.222.0.26 () {58 vars in 1024 bytes} [Wed Aug 17 19:06:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 17 19:06:42.267228 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8400a54f-aa93-44ff-a515-39ab9697293f None None] REQUEST_METHOD: `GET` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:06:42.267547 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8400a54f-aa93-44ff-a515-39ab9697293f None None] SCRIPT_NAME: `/identity` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:06:42.267841 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8400a54f-aa93-44ff-a515-39ab9697293f None None] PATH_INFO: `/` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:06:42.269363 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: [pid: 88550|app: 0|req: 333/649] 10.222.0.26 () {54 vars in 927 bytes} [Wed Aug 17 19:06:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 17 19:06:42.274062 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG dbcounter [-] [88551] Writing DB stats keystone:SELECT=100 {{(pid=88551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:06:42.275374 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aaab388-ffb8-4483-9aa7-a0a1f44c0947 None None] REQUEST_METHOD: `POST` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:06:42.275659 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aaab388-ffb8-4483-9aa7-a0a1f44c0947 None None] SCRIPT_NAME: `/identity` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:06:42.275931 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aaab388-ffb8-4483-9aa7-a0a1f44c0947 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:06:42.294106 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.auth.core [None req-2aaab388-ffb8-4483-9aa7-a0a1f44c0947 None None] MFA Rules not processed for user `819d41a279e64291acc60de51e1530ae`. Rule list: `[]` (Enabled: `True`). {{(pid=88550) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 19:06:42.295323 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.common.fernet_utils [None req-2aaab388-ffb8-4483-9aa7-a0a1f44c0947 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:06:42.309551 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54e6e40d-22d4-459a-a245-91ce86afa117 None admin] Validating token access rules against request {{(pid=88551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:06:42.345544 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb25a6ec-d031-431a-ac09-46f6d32346da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '819d41a279e64291acc60de51e1530ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:06:42.346161 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb25a6ec-d031-431a-ac09-46f6d32346da None admin] REQUEST_METHOD: `GET` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:06:42.346453 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb25a6ec-d031-431a-ac09-46f6d32346da None admin] SCRIPT_NAME: `/identity` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:06:42.346742 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb25a6ec-d031-431a-ac09-46f6d32346da None admin] PATH_INFO: `/v3/users` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:06:42.347472 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb25a6ec-d031-431a-ac09-46f6d32346da None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=88551) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 19:06:42.347767 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb25a6ec-d031-431a-ac09-46f6d32346da None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:06:42.349198 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb25a6ec-d031-431a-ac09-46f6d32346da None admin] RBAC: Authorization granted {{(pid=88551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:06:42.367760 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: [pid: 88551|app: 0|req: 317/650] 10.222.0.26 () {56 vars in 1133 bytes} [Wed Aug 17 19:06:42 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 17 19:06:42.369350 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d51f1d-efcf-4977-9289-74f4154740c4 None None] REQUEST_METHOD: `GET` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:06:42.369883 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d51f1d-efcf-4977-9289-74f4154740c4 None None] SCRIPT_NAME: `/identity` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:06:42.370330 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d51f1d-efcf-4977-9289-74f4154740c4 None None] PATH_INFO: `/` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:06:42.371837 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: [pid: 88551|app: 0|req: 318/651] 10.222.0.26 () {54 vars in 927 bytes} [Wed Aug 17 19:06:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 19:06:42.373785 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90d51f1d-efcf-4977-9289-74f4154740c4 None None] Authenticating user token {{(pid=88551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:06:42.378059 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: [pid: 88550|app: 0|req: 334/652] 10.222.0.26 () {58 vars in 1024 bytes} [Wed Aug 17 19:06:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 17 19:06:42.379164 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-720f17b8-3153-47b5-a989-c031a1d291fb None None] REQUEST_METHOD: `POST` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:06:42.379518 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-720f17b8-3153-47b5-a989-c031a1d291fb None None] SCRIPT_NAME: `/identity` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:06:42.379856 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-720f17b8-3153-47b5-a989-c031a1d291fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:06:42.398032 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.auth.core [None req-720f17b8-3153-47b5-a989-c031a1d291fb None None] MFA Rules not processed for user `819d41a279e64291acc60de51e1530ae`. Rule list: `[]` (Enabled: `True`). {{(pid=88550) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 19:06:42.399633 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.common.fernet_utils [None req-720f17b8-3153-47b5-a989-c031a1d291fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:06:42.475123 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: [pid: 88550|app: 0|req: 335/653] 10.222.0.26 () {58 vars in 1024 bytes} [Wed Aug 17 19:06:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 17 19:06:42.487581 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90d51f1d-efcf-4977-9289-74f4154740c4 None None] Validating token access rules against request {{(pid=88551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:06:42.517185 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG dbcounter [-] [88551] Writing DB stats keystone:SELECT=100 {{(pid=88551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:06:42.525772 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d418910-8a00-409b-8b1b-2194ae046959 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '819d41a279e64291acc60de51e1530ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:06:42.526673 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d418910-8a00-409b-8b1b-2194ae046959 None admin] REQUEST_METHOD: `GET` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:06:42.527161 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d418910-8a00-409b-8b1b-2194ae046959 None admin] SCRIPT_NAME: `/identity` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:06:42.527657 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d418910-8a00-409b-8b1b-2194ae046959 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:06:42.584948 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-720f17b8-3153-47b5-a989-c031a1d291fb None None] Authenticating user token {{(pid=88550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:06:42.602317 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d418910-8a00-409b-8b1b-2194ae046959 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:06:42.604134 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d418910-8a00-409b-8b1b-2194ae046959 None admin] RBAC: Authorization granted {{(pid=88551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:06:42.618899 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG dbcounter [-] [88550] Writing DB stats keystone:SELECT=100 {{(pid=88550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:06:42.744138 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: [pid: 88551|app: 0|req: 319/654] 10.222.0.26 () {58 vars in 1282 bytes} [Wed Aug 17 19:06:42 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 371 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 17 19:06:42.746001 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-720f17b8-3153-47b5-a989-c031a1d291fb None None] Validating token access rules against request {{(pid=88550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:06:42.749616 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d418910-8a00-409b-8b1b-2194ae046959 None admin] Authenticating user token {{(pid=88551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:06:42.777812 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG dbcounter [-] [88551] Writing DB stats keystone:SELECT=100 {{(pid=88551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:06:42.788106 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76565192-a9fe-4b6f-a107-41fee6e9397e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '819d41a279e64291acc60de51e1530ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:06:42.788725 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76565192-a9fe-4b6f-a107-41fee6e9397e None admin] REQUEST_METHOD: `GET` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:06:42.789003 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76565192-a9fe-4b6f-a107-41fee6e9397e None admin] SCRIPT_NAME: `/identity` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:06:42.793707 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76565192-a9fe-4b6f-a107-41fee6e9397e None admin] PATH_INFO: `/v3/services/image` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:06:42.793707 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76565192-a9fe-4b6f-a107-41fee6e9397e None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:06:42.793707 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76565192-a9fe-4b6f-a107-41fee6e9397e None admin] RBAC: Authorization granted {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:06:42.801909 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application [None req-76565192-a9fe-4b6f-a107-41fee6e9397e None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Aug 17 19:06:42.801909 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 19:06:42.801909 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 17 19:06:42.801909 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 17 19:06:42.801909 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 17 19:06:42.801909 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 17 19:06:42.801909 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 17 19:06:42.801909 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 17 19:06:42.801909 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 17 19:06:42.801909 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application Aug 17 19:06:42.801909 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 17 19:06:42.801909 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application Aug 17 19:06:42.801909 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 19:06:42.801909 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 19:06:42.801909 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 19:06:42.801909 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 19:06:42.801909 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 19:06:42.803211 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 19:06:42.803211 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 19:06:42.803211 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 19:06:42.803211 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 19:06:42.803211 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 19:06:42.803211 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 19:06:42.803211 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 17 19:06:42.803211 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 17 19:06:42.803211 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 17 19:06:42.803211 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 17 19:06:42.803211 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 19:06:42.803211 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 19:06:42.803211 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 19:06:42.803211 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 19:06:42.803211 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 19:06:42.803211 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 19:06:42.804097 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 19:06:42.804097 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application with Lock( Aug 17 19:06:42.804097 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 19:06:42.804097 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return self._enter() Aug 17 19:06:42.804097 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 19:06:42.804097 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 19:06:42.804097 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 19:06:42.804097 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return self.creator() Aug 17 19:06:42.804097 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 19:06:42.804097 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application created_value = creator( Aug 17 19:06:42.804097 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 17 19:06:42.804097 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 17 19:06:42.804097 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 17 19:06:42.804097 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application Aug 17 19:06:42.806876 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: [pid: 88550|app: 0|req: 336/655] 10.222.0.26 () {56 vars in 1105 bytes} [Wed Aug 17 19:06:42 2022] GET /identity/v3/services/image => generated 86 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 17 19:06:42.807765 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76565192-a9fe-4b6f-a107-41fee6e9397e None admin] Authenticating user token {{(pid=88550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:06:42.853933 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d418910-8a00-409b-8b1b-2194ae046959 None admin] Validating token access rules against request {{(pid=88551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:06:42.887607 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e01f7421-de1a-4e49-a3d0-a1cdd36c5b6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '819d41a279e64291acc60de51e1530ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:06:42.888731 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e01f7421-de1a-4e49-a3d0-a1cdd36c5b6e None admin] REQUEST_METHOD: `GET` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:06:42.889013 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e01f7421-de1a-4e49-a3d0-a1cdd36c5b6e None admin] SCRIPT_NAME: `/identity` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:06:42.889286 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e01f7421-de1a-4e49-a3d0-a1cdd36c5b6e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:06:42.899473 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e01f7421-de1a-4e49-a3d0-a1cdd36c5b6e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:06:42.900906 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e01f7421-de1a-4e49-a3d0-a1cdd36c5b6e None admin] RBAC: Authorization granted {{(pid=88551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:06:42.902039 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG dbcounter [-] [88550] Writing DB stats keystone:SELECT=100 {{(pid=88550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:06:42.911757 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76565192-a9fe-4b6f-a107-41fee6e9397e None admin] Validating token access rules against request {{(pid=88550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:06:42.916006 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application [None req-e01f7421-de1a-4e49-a3d0-a1cdd36c5b6e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 19:06:42.916006 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 19:06:42.916006 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 19:06:42.916006 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 19:06:42.916006 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 19:06:42.916006 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 19:06:42.916006 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 19:06:42.916006 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 19:06:42.916006 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 19:06:42.916006 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 19:06:42.916006 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 19:06:42.916006 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 19:06:42.916006 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 17 19:06:42.916006 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 17 19:06:42.916006 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 17 19:06:42.916006 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 17 19:06:42.919959 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 19:06:42.919959 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 19:06:42.919959 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 19:06:42.919959 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 19:06:42.919959 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 19:06:42.919959 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 19:06:42.919959 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 19:06:42.919959 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application with Lock( Aug 17 19:06:42.919959 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 19:06:42.919959 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application return self._enter() Aug 17 19:06:42.919959 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 19:06:42.919959 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 19:06:42.919959 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 19:06:42.919959 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application return self.creator() Aug 17 19:06:42.919959 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 19:06:42.919959 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application created_value = creator( Aug 17 19:06:42.919959 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 17 19:06:42.921150 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 17 19:06:42.921150 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 19:06:42.921150 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application Aug 17 19:06:42.921150 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: [pid: 88551|app: 0|req: 320/656] 10.222.0.26 () {56 vars in 1108 bytes} [Wed Aug 17 19:06:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 19:06:42.921150 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e01f7421-de1a-4e49-a3d0-a1cdd36c5b6e None admin] Authenticating user token {{(pid=88551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:06:42.951372 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31ee0a17-c3f3-47e9-90bb-a34021f6463c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '819d41a279e64291acc60de51e1530ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:06:42.952070 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ee0a17-c3f3-47e9-90bb-a34021f6463c None admin] REQUEST_METHOD: `GET` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:06:42.952356 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ee0a17-c3f3-47e9-90bb-a34021f6463c None admin] SCRIPT_NAME: `/identity` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:06:42.952628 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ee0a17-c3f3-47e9-90bb-a34021f6463c None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:06:42.953262 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31ee0a17-c3f3-47e9-90bb-a34021f6463c None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:06:42.955481 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31ee0a17-c3f3-47e9-90bb-a34021f6463c None admin] RBAC: Authorization granted {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:06:42.964172 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application [None req-31ee0a17-c3f3-47e9-90bb-a34021f6463c None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 17 19:06:42.964172 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 19:06:42.964172 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 17 19:06:42.964172 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 17 19:06:42.964172 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 17 19:06:42.964172 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 17 19:06:42.964172 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 17 19:06:42.964172 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 17 19:06:42.964172 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 17 19:06:42.964172 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application Aug 17 19:06:42.964172 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 17 19:06:42.964172 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application Aug 17 19:06:42.964172 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 19:06:42.964172 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 19:06:42.964172 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 19:06:42.964172 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 19:06:42.964172 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 19:06:42.965466 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 19:06:42.965466 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 19:06:42.965466 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 19:06:42.965466 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 19:06:42.965466 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 19:06:42.965466 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 19:06:42.965466 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 17 19:06:42.965466 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 17 19:06:42.965466 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 17 19:06:42.965466 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 17 19:06:42.965466 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 19:06:42.965466 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 19:06:42.965466 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 19:06:42.965466 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 19:06:42.965466 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 19:06:42.965466 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 19:06:42.966322 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 19:06:42.966322 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application with Lock( Aug 17 19:06:42.966322 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 19:06:42.966322 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return self._enter() Aug 17 19:06:42.966322 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 19:06:42.966322 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 19:06:42.966322 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 19:06:42.966322 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return self.creator() Aug 17 19:06:42.966322 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 19:06:42.966322 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application created_value = creator( Aug 17 19:06:42.966322 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 17 19:06:42.966322 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 17 19:06:42.966322 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 17 19:06:42.966322 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application Aug 17 19:06:42.966322 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: [pid: 88550|app: 0|req: 337/657] 10.222.0.26 () {56 vars in 1129 bytes} [Wed Aug 17 19:06:42 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 19:06:42.967839 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31ee0a17-c3f3-47e9-90bb-a34021f6463c None admin] Authenticating user token {{(pid=88550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:06:43.006787 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG dbcounter [-] [88551] Writing DB stats keystone:SELECT=100 {{(pid=88551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:06:43.025592 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e01f7421-de1a-4e49-a3d0-a1cdd36c5b6e None admin] Validating token access rules against request {{(pid=88551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:06:43.061522 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69f469e0-606d-4312-848a-51b8739cb999 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '819d41a279e64291acc60de51e1530ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:06:43.062145 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f469e0-606d-4312-848a-51b8739cb999 None admin] REQUEST_METHOD: `GET` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:06:43.062422 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f469e0-606d-4312-848a-51b8739cb999 None admin] SCRIPT_NAME: `/identity` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:06:43.062724 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f469e0-606d-4312-848a-51b8739cb999 None admin] PATH_INFO: `/v3/services/network` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:06:43.063314 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69f469e0-606d-4312-848a-51b8739cb999 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=88551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:06:43.064687 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69f469e0-606d-4312-848a-51b8739cb999 None admin] RBAC: Authorization granted {{(pid=88551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:06:43.068678 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31ee0a17-c3f3-47e9-90bb-a34021f6463c None admin] Validating token access rules against request {{(pid=88550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:06:43.075604 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application [None req-69f469e0-606d-4312-848a-51b8739cb999 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Aug 17 19:06:43.075604 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 19:06:43.075604 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 17 19:06:43.075604 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 17 19:06:43.075604 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 17 19:06:43.075604 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 17 19:06:43.075604 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 17 19:06:43.075604 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 17 19:06:43.075604 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 17 19:06:43.075604 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application Aug 17 19:06:43.075604 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 17 19:06:43.075604 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application Aug 17 19:06:43.075604 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 19:06:43.075604 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 19:06:43.075604 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 19:06:43.075604 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 19:06:43.075604 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 19:06:43.077225 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 19:06:43.077225 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 19:06:43.077225 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 19:06:43.077225 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 19:06:43.077225 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 19:06:43.077225 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 19:06:43.077225 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 17 19:06:43.077225 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 17 19:06:43.077225 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 17 19:06:43.077225 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 17 19:06:43.077225 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 19:06:43.077225 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 19:06:43.077225 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 19:06:43.077225 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 19:06:43.077225 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 19:06:43.077225 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 19:06:43.078081 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 19:06:43.078081 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application with Lock( Aug 17 19:06:43.078081 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 19:06:43.078081 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application return self._enter() Aug 17 19:06:43.078081 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 19:06:43.078081 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 19:06:43.078081 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 19:06:43.078081 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application return self.creator() Aug 17 19:06:43.078081 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 19:06:43.078081 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application created_value = creator( Aug 17 19:06:43.078081 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 17 19:06:43.078081 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 17 19:06:43.078081 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 17 19:06:43.078081 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application Aug 17 19:06:43.078081 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: [pid: 88551|app: 0|req: 321/658] 10.222.0.26 () {56 vars in 1111 bytes} [Wed Aug 17 19:06:42 2022] GET /identity/v3/services/network => generated 88 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 19:06:43.078930 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69f469e0-606d-4312-848a-51b8739cb999 None admin] Authenticating user token {{(pid=88551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:06:43.104270 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a0b60e2-f7ec-437a-8faa-0e0504143626 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '819d41a279e64291acc60de51e1530ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:06:43.104876 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a0b60e2-f7ec-437a-8faa-0e0504143626 None admin] REQUEST_METHOD: `GET` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:06:43.105161 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a0b60e2-f7ec-437a-8faa-0e0504143626 None admin] SCRIPT_NAME: `/identity` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:06:43.105436 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a0b60e2-f7ec-437a-8faa-0e0504143626 None admin] PATH_INFO: `/v3/services` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:06:43.106068 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a0b60e2-f7ec-437a-8faa-0e0504143626 None admin] RBAC: Adding query filter params (name=image) {{(pid=88550) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 19:06:43.106373 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a0b60e2-f7ec-437a-8faa-0e0504143626 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:06:43.107925 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a0b60e2-f7ec-437a-8faa-0e0504143626 None admin] RBAC: Authorization granted {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:06:43.112307 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: [pid: 88550|app: 0|req: 338/659] 10.222.0.26 () {56 vars in 1108 bytes} [Wed Aug 17 19:06:42 2022] GET /identity/v3/services?name=image => generated 122 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 19:06:43.113241 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a0b60e2-f7ec-437a-8faa-0e0504143626 None admin] Authenticating user token {{(pid=88550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:06:43.133056 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG dbcounter [-] [88550] Writing DB stats keystone:SELECT=100 {{(pid=88550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:06:43.182022 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69f469e0-606d-4312-848a-51b8739cb999 None admin] Validating token access rules against request {{(pid=88551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:06:43.212644 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a0b60e2-f7ec-437a-8faa-0e0504143626 None admin] Validating token access rules against request {{(pid=88550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:06:43.219007 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-582be76b-2f33-4511-8420-a40472cf5b6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '819d41a279e64291acc60de51e1530ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:06:43.219606 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-582be76b-2f33-4511-8420-a40472cf5b6d None admin] REQUEST_METHOD: `GET` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:06:43.219881 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-582be76b-2f33-4511-8420-a40472cf5b6d None admin] SCRIPT_NAME: `/identity` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:06:43.220152 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-582be76b-2f33-4511-8420-a40472cf5b6d None admin] PATH_INFO: `/v3/domains` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:06:43.220788 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-582be76b-2f33-4511-8420-a40472cf5b6d None admin] RBAC: Adding query filter params (name=Default) {{(pid=88551) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 19:06:43.221089 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-582be76b-2f33-4511-8420-a40472cf5b6d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:06:43.222455 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-582be76b-2f33-4511-8420-a40472cf5b6d None admin] RBAC: Authorization granted {{(pid=88551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:06:43.233924 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: [pid: 88551|app: 0|req: 322/660] 10.222.0.26 () {56 vars in 1109 bytes} [Wed Aug 17 19:06:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 19:06:43.234558 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-582be76b-2f33-4511-8420-a40472cf5b6d None admin] Authenticating user token {{(pid=88551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:06:43.238027 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG dbcounter [-] [88551] Writing DB stats keystone:SELECT=100 {{(pid=88551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:06:43.252133 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d01ac463-7fe1-46f8-ab7c-dde73c0b8999 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '819d41a279e64291acc60de51e1530ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:06:43.252831 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d01ac463-7fe1-46f8-ab7c-dde73c0b8999 None admin] REQUEST_METHOD: `GET` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:06:43.253011 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d01ac463-7fe1-46f8-ab7c-dde73c0b8999 None admin] SCRIPT_NAME: `/identity` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:06:43.253284 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d01ac463-7fe1-46f8-ab7c-dde73c0b8999 None admin] PATH_INFO: `/v3/services` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:06:43.253987 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d01ac463-7fe1-46f8-ab7c-dde73c0b8999 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=88550) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 19:06:43.254328 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d01ac463-7fe1-46f8-ab7c-dde73c0b8999 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:06:43.255698 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d01ac463-7fe1-46f8-ab7c-dde73c0b8999 None admin] RBAC: Authorization granted {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:06:43.259899 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: [pid: 88550|app: 0|req: 339/661] 10.222.0.26 () {56 vars in 1124 bytes} [Wed Aug 17 19:06:43 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 19:06:43.260606 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d01ac463-7fe1-46f8-ab7c-dde73c0b8999 None admin] Authenticating user token {{(pid=88550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:06:43.338160 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-582be76b-2f33-4511-8420-a40472cf5b6d None admin] Validating token access rules against request {{(pid=88551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:06:43.345070 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG dbcounter [-] [88550] Writing DB stats keystone:SELECT=100 {{(pid=88550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:06:43.362869 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d01ac463-7fe1-46f8-ab7c-dde73c0b8999 None admin] Validating token access rules against request {{(pid=88550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:06:43.371900 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b43a9ac2-0efd-4f2d-b4b8-ef5096db68dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '819d41a279e64291acc60de51e1530ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:06:43.372526 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b43a9ac2-0efd-4f2d-b4b8-ef5096db68dd None admin] REQUEST_METHOD: `GET` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:06:43.373296 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b43a9ac2-0efd-4f2d-b4b8-ef5096db68dd None admin] SCRIPT_NAME: `/identity` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:06:43.373571 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b43a9ac2-0efd-4f2d-b4b8-ef5096db68dd None admin] PATH_INFO: `/v3/services` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:06:43.374194 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b43a9ac2-0efd-4f2d-b4b8-ef5096db68dd None admin] RBAC: Adding query filter params (name=network) {{(pid=88551) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 19:06:43.374499 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b43a9ac2-0efd-4f2d-b4b8-ef5096db68dd None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:06:43.375922 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b43a9ac2-0efd-4f2d-b4b8-ef5096db68dd None admin] RBAC: Authorization granted {{(pid=88551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:06:43.380385 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: [pid: 88551|app: 0|req: 323/662] 10.222.0.26 () {56 vars in 1112 bytes} [Wed Aug 17 19:06:43 2022] GET /identity/v3/services?name=network => generated 124 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 19:06:43.381451 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b43a9ac2-0efd-4f2d-b4b8-ef5096db68dd None admin] Authenticating user token {{(pid=88551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:06:43.398357 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6397301-8fd5-4cfc-b1be-0bbb97259493 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '819d41a279e64291acc60de51e1530ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:06:43.399000 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6397301-8fd5-4cfc-b1be-0bbb97259493 None admin] REQUEST_METHOD: `GET` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:06:43.399284 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6397301-8fd5-4cfc-b1be-0bbb97259493 None admin] SCRIPT_NAME: `/identity` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:06:43.399559 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6397301-8fd5-4cfc-b1be-0bbb97259493 None admin] PATH_INFO: `/v3/services` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:06:43.400194 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6397301-8fd5-4cfc-b1be-0bbb97259493 None admin] RBAC: Adding query filter params (type=image) {{(pid=88550) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 19:06:43.400519 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6397301-8fd5-4cfc-b1be-0bbb97259493 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:06:43.402021 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6397301-8fd5-4cfc-b1be-0bbb97259493 None admin] RBAC: Authorization granted {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:06:43.407726 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: [pid: 88550|app: 0|req: 340/663] 10.222.0.26 () {56 vars in 1108 bytes} [Wed Aug 17 19:06:43 2022] GET /identity/v3/services?type=image => generated 122 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 19:06:43.408520 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6397301-8fd5-4cfc-b1be-0bbb97259493 None admin] Authenticating user token {{(pid=88550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:06:43.479369 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG dbcounter [-] [88551] Writing DB stats keystone:SELECT=100 {{(pid=88551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:06:43.522076 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b43a9ac2-0efd-4f2d-b4b8-ef5096db68dd None admin] Validating token access rules against request {{(pid=88551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:06:43.542627 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6397301-8fd5-4cfc-b1be-0bbb97259493 None admin] Validating token access rules against request {{(pid=88550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:06:43.564102 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-191fa3d5-a7ae-4bed-8c27-f7d5d49b00f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '819d41a279e64291acc60de51e1530ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:06:43.564836 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-191fa3d5-a7ae-4bed-8c27-f7d5d49b00f0 None admin] REQUEST_METHOD: `GET` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:06:43.565189 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-191fa3d5-a7ae-4bed-8c27-f7d5d49b00f0 None admin] SCRIPT_NAME: `/identity` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:06:43.565648 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-191fa3d5-a7ae-4bed-8c27-f7d5d49b00f0 None admin] PATH_INFO: `/v3/projects/service` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:06:43.573803 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-191fa3d5-a7ae-4bed-8c27-f7d5d49b00f0 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:06:43.575608 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-191fa3d5-a7ae-4bed-8c27-f7d5d49b00f0 None admin] RBAC: Authorization granted {{(pid=88551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:06:43.580118 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-800e3e97-9197-496d-8b13-2d974f7b0e03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '819d41a279e64291acc60de51e1530ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:06:43.580802 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-800e3e97-9197-496d-8b13-2d974f7b0e03 None admin] REQUEST_METHOD: `GET` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:06:43.581149 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-800e3e97-9197-496d-8b13-2d974f7b0e03 None admin] SCRIPT_NAME: `/identity` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:06:43.581534 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-800e3e97-9197-496d-8b13-2d974f7b0e03 None admin] PATH_INFO: `/v3/services` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:06:43.582234 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-800e3e97-9197-496d-8b13-2d974f7b0e03 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=88550) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 19:06:43.582642 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-800e3e97-9197-496d-8b13-2d974f7b0e03 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:06:43.584119 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-800e3e97-9197-496d-8b13-2d974f7b0e03 None admin] RBAC: Authorization granted {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:06:43.588858 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application [None req-191fa3d5-a7ae-4bed-8c27-f7d5d49b00f0 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 17 19:06:43.588858 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 19:06:43.588858 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 19:06:43.588858 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 19:06:43.588858 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 19:06:43.588858 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 19:06:43.588858 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 19:06:43.588858 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 19:06:43.588858 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 19:06:43.588858 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 19:06:43.588858 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 19:06:43.588858 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 19:06:43.588858 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 17 19:06:43.588858 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 17 19:06:43.588858 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 17 19:06:43.590406 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 17 19:06:43.590406 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 19:06:43.590406 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 19:06:43.590406 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 19:06:43.590406 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 19:06:43.590406 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 19:06:43.590406 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 19:06:43.590406 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 19:06:43.590406 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application with Lock( Aug 17 19:06:43.590406 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 19:06:43.590406 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application return self._enter() Aug 17 19:06:43.590406 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 19:06:43.590406 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 19:06:43.590406 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 19:06:43.590406 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application return self.creator() Aug 17 19:06:43.590406 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 19:06:43.590406 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application created_value = creator( Aug 17 19:06:43.598927 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 17 19:06:43.598927 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 17 19:06:43.598927 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 17 19:06:43.598927 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 17 19:06:43.598927 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 17 19:06:43.598927 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 17 19:06:43.598927 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 17 19:06:43.598927 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application Aug 17 19:06:43.598927 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: [pid: 88551|app: 0|req: 324/664] 10.222.0.26 () {56 vars in 1111 bytes} [Wed Aug 17 19:06:43 2022] GET /identity/v3/projects/service => generated 88 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 19:06:43.599462 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: [pid: 88550|app: 0|req: 341/665] 10.222.0.26 () {56 vars in 1124 bytes} [Wed Aug 17 19:06:43 2022] GET /identity/v3/services?type=block-storage => generated 130 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 19:06:43.599538 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-191fa3d5-a7ae-4bed-8c27-f7d5d49b00f0 None admin] Authenticating user token {{(pid=88551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:06:43.599608 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-800e3e97-9197-496d-8b13-2d974f7b0e03 None admin] Authenticating user token {{(pid=88550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:06:43.613056 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG dbcounter [-] [88550] Writing DB stats keystone:SELECT=100 {{(pid=88550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:06:43.729813 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-191fa3d5-a7ae-4bed-8c27-f7d5d49b00f0 None admin] Validating token access rules against request {{(pid=88551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:06:43.764342 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-800e3e97-9197-496d-8b13-2d974f7b0e03 None admin] Validating token access rules against request {{(pid=88550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:06:43.770175 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG dbcounter [-] [88551] Writing DB stats keystone:SELECT=100 {{(pid=88551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:06:43.781399 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbcebeec-dab3-4be9-928a-fd3766440b34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '819d41a279e64291acc60de51e1530ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:06:43.783202 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbcebeec-dab3-4be9-928a-fd3766440b34 None admin] REQUEST_METHOD: `GET` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:06:43.783202 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbcebeec-dab3-4be9-928a-fd3766440b34 None admin] SCRIPT_NAME: `/identity` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:06:43.783202 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbcebeec-dab3-4be9-928a-fd3766440b34 None admin] PATH_INFO: `/v3/services` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:06:43.786625 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbcebeec-dab3-4be9-928a-fd3766440b34 None admin] RBAC: Adding query filter params (type=network) {{(pid=88551) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 19:06:43.786625 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbcebeec-dab3-4be9-928a-fd3766440b34 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:06:43.786625 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbcebeec-dab3-4be9-928a-fd3766440b34 None admin] RBAC: Authorization granted {{(pid=88551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:06:43.794651 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: [pid: 88551|app: 0|req: 325/666] 10.222.0.26 () {56 vars in 1112 bytes} [Wed Aug 17 19:06:43 2022] GET /identity/v3/services?type=network => generated 124 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 19:06:43.813370 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aed2021-597f-4bdb-9a02-c1cfd66c9894 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '819d41a279e64291acc60de51e1530ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:06:43.814001 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aed2021-597f-4bdb-9a02-c1cfd66c9894 None admin] REQUEST_METHOD: `GET` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:06:43.814282 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aed2021-597f-4bdb-9a02-c1cfd66c9894 None admin] SCRIPT_NAME: `/identity` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:06:43.815325 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aed2021-597f-4bdb-9a02-c1cfd66c9894 None admin] PATH_INFO: `/v3/projects` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:06:43.815325 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aed2021-597f-4bdb-9a02-c1cfd66c9894 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88550) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 19:06:43.815645 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aed2021-597f-4bdb-9a02-c1cfd66c9894 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:06:43.817110 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aed2021-597f-4bdb-9a02-c1cfd66c9894 None admin] RBAC: Authorization granted {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:06:43.831333 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: [pid: 88550|app: 0|req: 342/667] 10.222.0.26 () {56 vars in 1148 bytes} [Wed Aug 17 19:06:43 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 19:06:43.837394 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbcebeec-dab3-4be9-928a-fd3766440b34 None admin] Authenticating user token {{(pid=88551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:06:43.954872 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbcebeec-dab3-4be9-928a-fd3766440b34 None admin] Validating token access rules against request {{(pid=88551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:06:43.994878 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6823de22-e758-425a-9d81-18d0227d7fbc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '819d41a279e64291acc60de51e1530ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:06:43.995486 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6823de22-e758-425a-9d81-18d0227d7fbc None admin] REQUEST_METHOD: `GET` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:06:43.995769 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6823de22-e758-425a-9d81-18d0227d7fbc None admin] SCRIPT_NAME: `/identity` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:06:43.996044 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6823de22-e758-425a-9d81-18d0227d7fbc None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:06:43.996774 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6823de22-e758-425a-9d81-18d0227d7fbc None admin] RBAC: Adding query filter params (role.id=204f62ae18174b60a2e3f5d4f28ea326, scope.project.id=4bbf6c5abd684d899d09a08b0847d81c, user.id=9ae23e7a10d54989a25c9f3019184d01) {{(pid=88551) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 19:06:43.997081 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6823de22-e758-425a-9d81-18d0227d7fbc None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:06:43.998571 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6823de22-e758-425a-9d81-18d0227d7fbc None admin] RBAC: Authorization granted {{(pid=88551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:06:44.006521 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: [pid: 88551|app: 0|req: 326/668] 10.222.0.26 () {56 vars in 1374 bytes} [Wed Aug 17 19:06:43 2022] GET /identity/v3/role_assignments?user.id=9ae23e7a10d54989a25c9f3019184d01&scope.project.id=4bbf6c5abd684d899d09a08b0847d81c&role.id=204f62ae18174b60a2e3f5d4f28ea326 => generated 259 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 19:06:45.701298 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aad6e8f-49f0-46af-ac6f-ff87ada8f721 None None] REQUEST_METHOD: `GET` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:06:45.701886 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aad6e8f-49f0-46af-ac6f-ff87ada8f721 None None] SCRIPT_NAME: `/identity` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:06:45.701978 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aad6e8f-49f0-46af-ac6f-ff87ada8f721 None None] PATH_INFO: `/` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:06:45.703561 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: [pid: 88550|app: 0|req: 343/669] 10.222.0.26 () {54 vars in 927 bytes} [Wed Aug 17 19:06:45 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 19:06:45.709840 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d7a7f59-0b50-47f7-b1c5-a2ef60c6b4b1 None None] REQUEST_METHOD: `POST` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:06:45.710851 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d7a7f59-0b50-47f7-b1c5-a2ef60c6b4b1 None None] SCRIPT_NAME: `/identity` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:06:45.711393 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d7a7f59-0b50-47f7-b1c5-a2ef60c6b4b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:06:45.732976 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.auth.core [None req-0d7a7f59-0b50-47f7-b1c5-a2ef60c6b4b1 None None] MFA Rules not processed for user `819d41a279e64291acc60de51e1530ae`. Rule list: `[]` (Enabled: `True`). {{(pid=88551) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 19:06:45.734652 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.common.fernet_utils [None req-0d7a7f59-0b50-47f7-b1c5-a2ef60c6b4b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:06:45.790481 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG dbcounter [-] [88551] Writing DB stats keystone:SELECT=100 {{(pid=88551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:06:45.808317 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: [pid: 88551|app: 0|req: 327/670] 10.222.0.26 () {58 vars in 1024 bytes} [Wed Aug 17 19:06:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 17 19:06:45.875192 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b525c858-9efa-4e02-83ca-b4db965ffa08 None None] REQUEST_METHOD: `GET` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:06:45.875524 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b525c858-9efa-4e02-83ca-b4db965ffa08 None None] SCRIPT_NAME: `/identity` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:06:45.875745 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b525c858-9efa-4e02-83ca-b4db965ffa08 None None] PATH_INFO: `/` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:06:45.877373 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: [pid: 88550|app: 0|req: 344/671] 10.222.0.26 () {54 vars in 927 bytes} [Wed Aug 17 19:06:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 19:06:45.882510 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb6c3f6-5d4e-4462-ae62-89edb294e48e None None] REQUEST_METHOD: `POST` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:06:45.882840 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb6c3f6-5d4e-4462-ae62-89edb294e48e None None] SCRIPT_NAME: `/identity` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:06:45.883119 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb6c3f6-5d4e-4462-ae62-89edb294e48e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:06:45.903095 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.auth.core [None req-fcb6c3f6-5d4e-4462-ae62-89edb294e48e None None] MFA Rules not processed for user `819d41a279e64291acc60de51e1530ae`. Rule list: `[]` (Enabled: `True`). {{(pid=88551) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 19:06:45.904983 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.common.fernet_utils [None req-fcb6c3f6-5d4e-4462-ae62-89edb294e48e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:06:46.108825 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: [pid: 88551|app: 0|req: 328/672] 10.222.0.26 () {58 vars in 1024 bytes} [Wed Aug 17 19:06:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 227 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 17 19:06:46.134481 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c07a8a6d-abf5-4f66-a125-c0453f9b284b None None] REQUEST_METHOD: `GET` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:06:46.134836 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c07a8a6d-abf5-4f66-a125-c0453f9b284b None None] SCRIPT_NAME: `/identity` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:06:46.135075 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c07a8a6d-abf5-4f66-a125-c0453f9b284b None None] PATH_INFO: `/` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:06:46.136565 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: [pid: 88550|app: 0|req: 345/673] 10.222.0.26 () {54 vars in 927 bytes} [Wed Aug 17 19:06:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 19:06:46.142817 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22df4d1e-9345-4aa9-8d0c-c543dcd9c50f None None] REQUEST_METHOD: `POST` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:06:46.143390 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22df4d1e-9345-4aa9-8d0c-c543dcd9c50f None None] SCRIPT_NAME: `/identity` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:06:46.143867 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22df4d1e-9345-4aa9-8d0c-c543dcd9c50f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:06:46.147459 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c07a8a6d-abf5-4f66-a125-c0453f9b284b None None] Authenticating user token {{(pid=88550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:06:46.162765 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.auth.core [None req-22df4d1e-9345-4aa9-8d0c-c543dcd9c50f None None] MFA Rules not processed for user `819d41a279e64291acc60de51e1530ae`. Rule list: `[]` (Enabled: `True`). {{(pid=88551) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 19:06:46.164335 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.common.fernet_utils [None req-22df4d1e-9345-4aa9-8d0c-c543dcd9c50f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:06:46.237509 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: [pid: 88551|app: 0|req: 329/674] 10.222.0.26 () {58 vars in 1024 bytes} [Wed Aug 17 19:06:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 17 19:06:46.238686 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a5fa1ce-744c-4359-bf81-0b32e3720e01 None None] REQUEST_METHOD: `GET` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:06:46.238965 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a5fa1ce-744c-4359-bf81-0b32e3720e01 None None] SCRIPT_NAME: `/identity` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:06:46.239230 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a5fa1ce-744c-4359-bf81-0b32e3720e01 None None] PATH_INFO: `/` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:06:46.240471 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: [pid: 88551|app: 0|req: 330/675] 10.222.0.26 () {54 vars in 927 bytes} [Wed Aug 17 19:06:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 19:06:46.243625 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG dbcounter [-] [88550] Writing DB stats keystone:SELECT=100 {{(pid=88550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:06:46.246021 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cfd152e-2da8-419f-8d73-3b8616c12a1d None None] REQUEST_METHOD: `POST` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:06:46.246021 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cfd152e-2da8-419f-8d73-3b8616c12a1d None None] SCRIPT_NAME: `/identity` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:06:46.246021 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cfd152e-2da8-419f-8d73-3b8616c12a1d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:06:46.264855 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.auth.core [None req-0cfd152e-2da8-419f-8d73-3b8616c12a1d None None] MFA Rules not processed for user `819d41a279e64291acc60de51e1530ae`. Rule list: `[]` (Enabled: `True`). {{(pid=88551) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 19:06:46.266030 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.common.fernet_utils [None req-0cfd152e-2da8-419f-8d73-3b8616c12a1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:06:46.285199 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c07a8a6d-abf5-4f66-a125-c0453f9b284b None None] Validating token access rules against request {{(pid=88550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:06:46.309853 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG dbcounter [-] [88551] Writing DB stats keystone:SELECT=100 {{(pid=88551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:06:46.331921 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-754ce9b3-415e-40bd-aaf9-50725c83a3e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '819d41a279e64291acc60de51e1530ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:06:46.332535 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-754ce9b3-415e-40bd-aaf9-50725c83a3e0 None admin] REQUEST_METHOD: `POST` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:06:46.332811 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-754ce9b3-415e-40bd-aaf9-50725c83a3e0 None admin] SCRIPT_NAME: `/identity` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:06:46.333138 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-754ce9b3-415e-40bd-aaf9-50725c83a3e0 None admin] PATH_INFO: `/v3/services` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:06:46.333812 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-754ce9b3-415e-40bd-aaf9-50725c83a3e0 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:06:46.335233 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-754ce9b3-415e-40bd-aaf9-50725c83a3e0 None admin] RBAC: Authorization granted {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:06:46.339928 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: [pid: 88551|app: 0|req: 331/676] 10.222.0.26 () {58 vars in 1024 bytes} [Wed Aug 17 19:06:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 17 19:06:46.440438 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: [pid: 88550|app: 0|req: 346/677] 10.222.0.26 () {60 vars in 1141 bytes} [Wed Aug 17 19:06:46 2022] POST /identity/v3/services => generated 242 bytes in 290 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 17 19:06:46.441795 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cfd152e-2da8-419f-8d73-3b8616c12a1d None None] Authenticating user token {{(pid=88551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:06:46.569772 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cfd152e-2da8-419f-8d73-3b8616c12a1d None None] Validating token access rules against request {{(pid=88551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:06:46.595027 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-754ce9b3-415e-40bd-aaf9-50725c83a3e0 None admin] Authenticating user token {{(pid=88550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:06:46.630268 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06dfd787-7bce-4f37-bbfd-e338a60c62c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '819d41a279e64291acc60de51e1530ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:06:46.631278 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06dfd787-7bce-4f37-bbfd-e338a60c62c7 None admin] REQUEST_METHOD: `POST` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:06:46.631806 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06dfd787-7bce-4f37-bbfd-e338a60c62c7 None admin] SCRIPT_NAME: `/identity` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:06:46.632400 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06dfd787-7bce-4f37-bbfd-e338a60c62c7 None admin] PATH_INFO: `/v3/services` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:06:46.633385 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06dfd787-7bce-4f37-bbfd-e338a60c62c7 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=88551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:06:46.634997 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06dfd787-7bce-4f37-bbfd-e338a60c62c7 None admin] RBAC: Authorization granted {{(pid=88551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:06:46.715563 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-754ce9b3-415e-40bd-aaf9-50725c83a3e0 None admin] Validating token access rules against request {{(pid=88550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:06:46.743814 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG dbcounter [-] [88550] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:06:46.749899 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5712d09a-8655-40aa-9b0a-80ae0d4dd06b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '819d41a279e64291acc60de51e1530ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:06:46.750503 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5712d09a-8655-40aa-9b0a-80ae0d4dd06b None admin] REQUEST_METHOD: `POST` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:06:46.750819 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5712d09a-8655-40aa-9b0a-80ae0d4dd06b None admin] SCRIPT_NAME: `/identity` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:06:46.751092 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5712d09a-8655-40aa-9b0a-80ae0d4dd06b None admin] PATH_INFO: `/v3/services` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:06:46.751743 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5712d09a-8655-40aa-9b0a-80ae0d4dd06b None admin] RBAC: Authorizing `identity:create_service()` {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:06:46.753105 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5712d09a-8655-40aa-9b0a-80ae0d4dd06b None admin] RBAC: Authorization granted {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:06:46.801401 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: [pid: 88551|app: 0|req: 332/678] 10.222.0.26 () {60 vars in 1141 bytes} [Wed Aug 17 19:06:46 2022] POST /identity/v3/services => generated 251 bytes in 360 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 19:06:46.802263 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06dfd787-7bce-4f37-bbfd-e338a60c62c7 None admin] Authenticating user token {{(pid=88551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:06:46.848361 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG dbcounter [-] [88551] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:06:46.918569 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: [pid: 88550|app: 0|req: 347/679] 10.222.0.26 () {60 vars in 1141 bytes} [Wed Aug 17 19:06:46 2022] POST /identity/v3/services => generated 240 bytes in 318 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 17 19:06:46.945565 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06dfd787-7bce-4f37-bbfd-e338a60c62c7 None admin] Validating token access rules against request {{(pid=88551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:06:47.026615 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1a4d99e-5879-4f09-86ec-d835cc9122bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '819d41a279e64291acc60de51e1530ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:06:47.027324 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a4d99e-5879-4f09-86ec-d835cc9122bf None admin] REQUEST_METHOD: `GET` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:06:47.027603 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a4d99e-5879-4f09-86ec-d835cc9122bf None admin] SCRIPT_NAME: `/identity` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:06:47.027872 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a4d99e-5879-4f09-86ec-d835cc9122bf None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:06:47.041815 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1a4d99e-5879-4f09-86ec-d835cc9122bf None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 17 19:06:47.046735 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application [None req-c1a4d99e-5879-4f09-86ec-d835cc9122bf None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 17 19:06:47.046735 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 19:06:47.046735 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 19:06:47.046735 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 19:06:47.046735 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 19:06:47.046735 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 19:06:47.046735 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 19:06:47.046735 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 19:06:47.046735 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 19:06:47.046735 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 19:06:47.046735 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 19:06:47.046735 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 19:06:47.046735 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 17 19:06:47.046735 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 17 19:06:47.046735 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 17 19:06:47.046735 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 17 19:06:47.047731 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 17 19:06:47.047731 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 17 19:06:47.047731 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 17 19:06:47.047731 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 17 19:06:47.047731 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 19:06:47.047731 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 19:06:47.047731 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 19:06:47.047731 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 19:06:47.047731 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 19:06:47.047731 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 19:06:47.047731 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 19:06:47.047731 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application with Lock( Aug 17 19:06:47.047731 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 19:06:47.047731 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application return self._enter() Aug 17 19:06:47.047731 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 19:06:47.047731 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 19:06:47.048595 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 19:06:47.048595 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application return self.creator() Aug 17 19:06:47.048595 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 19:06:47.048595 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application created_value = creator( Aug 17 19:06:47.048595 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 17 19:06:47.048595 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 17 19:06:47.048595 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 17 19:06:47.048595 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 17 19:06:47.048595 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 17 19:06:47.048595 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 17 19:06:47.048595 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 17 19:06:47.048595 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application Aug 17 19:06:47.048595 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: [pid: 88551|app: 0|req: 333/680] 10.222.0.26 () {56 vars in 1096 bytes} [Wed Aug 17 19:06:46 2022] GET /identity/v3/roles/admin => generated 83 bytes in 246 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 19:06:47.054322 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5712d09a-8655-40aa-9b0a-80ae0d4dd06b None admin] Authenticating user token {{(pid=88550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:06:47.171209 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5712d09a-8655-40aa-9b0a-80ae0d4dd06b None admin] Validating token access rules against request {{(pid=88550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:06:47.207676 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a832f85-4b13-4305-a284-c411a9765512 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '819d41a279e64291acc60de51e1530ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:06:47.208296 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a832f85-4b13-4305-a284-c411a9765512 None admin] REQUEST_METHOD: `GET` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:06:47.208571 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a832f85-4b13-4305-a284-c411a9765512 None admin] SCRIPT_NAME: `/identity` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:06:47.208839 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a832f85-4b13-4305-a284-c411a9765512 None admin] PATH_INFO: `/v3/roles` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:06:47.209506 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a832f85-4b13-4305-a284-c411a9765512 None admin] RBAC: Adding query filter params (name=admin) {{(pid=88550) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 19:06:47.209807 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a832f85-4b13-4305-a284-c411a9765512 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:06:47.211212 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a832f85-4b13-4305-a284-c411a9765512 None admin] RBAC: Authorization granted {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:06:47.220870 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: [pid: 88550|app: 0|req: 348/681] 10.222.0.26 () {56 vars in 1099 bytes} [Wed Aug 17 19:06:47 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 19:06:47.226504 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1a4d99e-5879-4f09-86ec-d835cc9122bf None admin] Authenticating user token {{(pid=88551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:06:47.318644 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG dbcounter [-] [88551] Writing DB stats keystone:SELECT=100 {{(pid=88551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:06:47.335075 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1a4d99e-5879-4f09-86ec-d835cc9122bf None admin] Validating token access rules against request {{(pid=88551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:06:47.369604 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a78c9619-c5ac-4cdd-a1a3-b1c16b541362 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '819d41a279e64291acc60de51e1530ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:06:47.370222 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a78c9619-c5ac-4cdd-a1a3-b1c16b541362 None admin] REQUEST_METHOD: `GET` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:06:47.370499 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a78c9619-c5ac-4cdd-a1a3-b1c16b541362 None admin] SCRIPT_NAME: `/identity` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:06:47.370796 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a78c9619-c5ac-4cdd-a1a3-b1c16b541362 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:06:47.381518 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a78c9619-c5ac-4cdd-a1a3-b1c16b541362 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:06:47.382984 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a78c9619-c5ac-4cdd-a1a3-b1c16b541362 None admin] RBAC: Authorization granted {{(pid=88551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:06:47.397385 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application [None req-a78c9619-c5ac-4cdd-a1a3-b1c16b541362 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 19:06:47.397385 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 19:06:47.397385 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 19:06:47.397385 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 19:06:47.397385 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 19:06:47.397385 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 19:06:47.397385 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 19:06:47.397385 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 19:06:47.397385 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 19:06:47.397385 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 19:06:47.397385 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 19:06:47.397385 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 19:06:47.397385 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 17 19:06:47.397385 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 17 19:06:47.397385 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 17 19:06:47.397385 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 17 19:06:47.398369 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 19:06:47.398369 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 19:06:47.398369 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 19:06:47.398369 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 19:06:47.398369 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 19:06:47.398369 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 19:06:47.398369 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 19:06:47.398369 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application with Lock( Aug 17 19:06:47.398369 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 19:06:47.398369 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application return self._enter() Aug 17 19:06:47.398369 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 19:06:47.398369 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 19:06:47.398369 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 19:06:47.398369 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application return self.creator() Aug 17 19:06:47.398369 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 19:06:47.398369 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application created_value = creator( Aug 17 19:06:47.398369 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 17 19:06:47.399403 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 17 19:06:47.399403 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 19:06:47.399403 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application Aug 17 19:06:47.399403 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: [pid: 88551|app: 0|req: 334/682] 10.222.0.26 () {56 vars in 1108 bytes} [Wed Aug 17 19:06:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 19:06:47.404760 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a832f85-4b13-4305-a284-c411a9765512 None admin] Authenticating user token {{(pid=88550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:06:47.464407 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG dbcounter [-] [88550] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:06:47.515244 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a832f85-4b13-4305-a284-c411a9765512 None admin] Validating token access rules against request {{(pid=88550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:06:47.554677 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38c90fc2-90a6-4545-bd0d-bb5878c10969 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '819d41a279e64291acc60de51e1530ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:06:47.555815 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c90fc2-90a6-4545-bd0d-bb5878c10969 None admin] REQUEST_METHOD: `GET` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:06:47.556092 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c90fc2-90a6-4545-bd0d-bb5878c10969 None admin] SCRIPT_NAME: `/identity` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:06:47.556364 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c90fc2-90a6-4545-bd0d-bb5878c10969 None admin] PATH_INFO: `/v3/domains` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:06:47.557011 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38c90fc2-90a6-4545-bd0d-bb5878c10969 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88550) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 19:06:47.557310 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38c90fc2-90a6-4545-bd0d-bb5878c10969 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:06:47.558774 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38c90fc2-90a6-4545-bd0d-bb5878c10969 None admin] RBAC: Authorization granted {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:06:47.571017 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: [pid: 88550|app: 0|req: 349/683] 10.222.0.26 () {56 vars in 1109 bytes} [Wed Aug 17 19:06:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 19:06:47.576190 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a78c9619-c5ac-4cdd-a1a3-b1c16b541362 None admin] Authenticating user token {{(pid=88551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:06:47.688211 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a78c9619-c5ac-4cdd-a1a3-b1c16b541362 None admin] Validating token access rules against request {{(pid=88551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:06:47.724621 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f5155ec-8ca9-4aef-8985-8e219d6b20a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '819d41a279e64291acc60de51e1530ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:06:47.725627 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f5155ec-8ca9-4aef-8985-8e219d6b20a2 None admin] REQUEST_METHOD: `GET` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:06:47.726109 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f5155ec-8ca9-4aef-8985-8e219d6b20a2 None admin] SCRIPT_NAME: `/identity` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:06:47.726627 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f5155ec-8ca9-4aef-8985-8e219d6b20a2 None admin] PATH_INFO: `/v3/users/nova` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:06:47.729597 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG dbcounter [-] [88551] Writing DB stats keystone:SELECT=100 {{(pid=88551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:06:47.735440 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f5155ec-8ca9-4aef-8985-8e219d6b20a2 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=88551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:06:47.737112 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f5155ec-8ca9-4aef-8985-8e219d6b20a2 None admin] RBAC: Authorization granted {{(pid=88551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:06:47.749243 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application [None req-3f5155ec-8ca9-4aef-8985-8e219d6b20a2 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 17 19:06:47.749243 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 19:06:47.749243 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 19:06:47.749243 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 19:06:47.749243 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 19:06:47.749243 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 19:06:47.749243 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 19:06:47.749243 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 19:06:47.749243 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 19:06:47.749243 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 19:06:47.749243 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 19:06:47.749243 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 19:06:47.749243 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 17 19:06:47.749243 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 17 19:06:47.749243 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 17 19:06:47.749243 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 17 19:06:47.752933 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 19:06:47.752933 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 19:06:47.752933 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 17 19:06:47.752933 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 17 19:06:47.752933 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 17 19:06:47.752933 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 17 19:06:47.752933 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 19:06:47.752933 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 19:06:47.752933 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 19:06:47.752933 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 19:06:47.752933 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 19:06:47.752933 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application with Lock( Aug 17 19:06:47.752933 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 19:06:47.752933 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application return self._enter() Aug 17 19:06:47.752933 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 19:06:47.752933 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 19:06:47.752933 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 19:06:47.752933 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application return self.creator() Aug 17 19:06:47.753916 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 19:06:47.753916 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application created_value = creator( Aug 17 19:06:47.753916 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 17 19:06:47.753916 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 17 19:06:47.753916 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 17 19:06:47.753916 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 17 19:06:47.753916 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 17 19:06:47.753916 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 17 19:06:47.753916 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 17 19:06:47.753916 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application Aug 17 19:06:47.753916 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: [pid: 88551|app: 0|req: 335/684] 10.222.0.26 () {56 vars in 1093 bytes} [Wed Aug 17 19:06:47 2022] GET /identity/v3/users/nova => generated 82 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 19:06:47.756526 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38c90fc2-90a6-4545-bd0d-bb5878c10969 None admin] Authenticating user token {{(pid=88550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:06:47.859209 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38c90fc2-90a6-4545-bd0d-bb5878c10969 None admin] Validating token access rules against request {{(pid=88550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:06:47.877526 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG dbcounter [-] [88550] Writing DB stats keystone:SELECT=100 {{(pid=88550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:06:47.898826 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dac80f5d-0e42-4f4f-95d4-a2f42ba1fc14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '819d41a279e64291acc60de51e1530ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:06:47.903869 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac80f5d-0e42-4f4f-95d4-a2f42ba1fc14 None admin] REQUEST_METHOD: `GET` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:06:47.903869 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac80f5d-0e42-4f4f-95d4-a2f42ba1fc14 None admin] SCRIPT_NAME: `/identity` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:06:47.903869 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac80f5d-0e42-4f4f-95d4-a2f42ba1fc14 None admin] PATH_INFO: `/v3/users` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:06:47.903869 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dac80f5d-0e42-4f4f-95d4-a2f42ba1fc14 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=88550) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 19:06:47.903869 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dac80f5d-0e42-4f4f-95d4-a2f42ba1fc14 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:06:47.903869 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dac80f5d-0e42-4f4f-95d4-a2f42ba1fc14 None admin] RBAC: Authorization granted {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:06:47.924375 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: [pid: 88550|app: 0|req: 350/685] 10.222.0.26 () {56 vars in 1133 bytes} [Wed Aug 17 19:06:47 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 17 19:06:47.925667 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f5155ec-8ca9-4aef-8985-8e219d6b20a2 None admin] Authenticating user token {{(pid=88551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:06:48.035640 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f5155ec-8ca9-4aef-8985-8e219d6b20a2 None admin] Validating token access rules against request {{(pid=88551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:06:48.072430 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca284647-315b-4ab7-8cf4-87f8da72e06a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '819d41a279e64291acc60de51e1530ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:06:48.073047 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca284647-315b-4ab7-8cf4-87f8da72e06a None admin] REQUEST_METHOD: `GET` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:06:48.073324 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca284647-315b-4ab7-8cf4-87f8da72e06a None admin] SCRIPT_NAME: `/identity` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:06:48.073593 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca284647-315b-4ab7-8cf4-87f8da72e06a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:06:48.085356 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca284647-315b-4ab7-8cf4-87f8da72e06a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:06:48.086887 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca284647-315b-4ab7-8cf4-87f8da72e06a None admin] RBAC: Authorization granted {{(pid=88551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:06:48.103912 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application [None req-ca284647-315b-4ab7-8cf4-87f8da72e06a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 19:06:48.103912 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 19:06:48.103912 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 19:06:48.103912 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 19:06:48.103912 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 19:06:48.103912 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 19:06:48.103912 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 19:06:48.103912 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 19:06:48.103912 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 19:06:48.103912 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 19:06:48.103912 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 19:06:48.103912 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 19:06:48.103912 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 17 19:06:48.103912 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 17 19:06:48.103912 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 17 19:06:48.103912 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 17 19:06:48.104987 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 19:06:48.104987 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 19:06:48.104987 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 19:06:48.104987 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 19:06:48.104987 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 19:06:48.104987 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 19:06:48.104987 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 19:06:48.104987 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application with Lock( Aug 17 19:06:48.104987 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 19:06:48.104987 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application return self._enter() Aug 17 19:06:48.104987 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 19:06:48.104987 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 19:06:48.104987 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 19:06:48.104987 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application return self.creator() Aug 17 19:06:48.104987 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 19:06:48.104987 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application created_value = creator( Aug 17 19:06:48.104987 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 17 19:06:48.106598 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 17 19:06:48.106598 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 19:06:48.106598 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application Aug 17 19:06:48.106598 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: [pid: 88551|app: 0|req: 336/686] 10.222.0.26 () {56 vars in 1108 bytes} [Wed Aug 17 19:06:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 19:06:48.111431 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dac80f5d-0e42-4f4f-95d4-a2f42ba1fc14 None admin] Authenticating user token {{(pid=88550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:06:48.216899 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dac80f5d-0e42-4f4f-95d4-a2f42ba1fc14 None admin] Validating token access rules against request {{(pid=88550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:06:48.251734 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5370e1aa-ac52-4ddb-89b9-0c2588db28be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '819d41a279e64291acc60de51e1530ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:06:48.252337 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5370e1aa-ac52-4ddb-89b9-0c2588db28be None admin] REQUEST_METHOD: `GET` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:06:48.252610 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5370e1aa-ac52-4ddb-89b9-0c2588db28be None admin] SCRIPT_NAME: `/identity` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:06:48.252875 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5370e1aa-ac52-4ddb-89b9-0c2588db28be None admin] PATH_INFO: `/v3/domains` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:06:48.253505 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5370e1aa-ac52-4ddb-89b9-0c2588db28be None admin] RBAC: Adding query filter params (name=Default) {{(pid=88550) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 19:06:48.253800 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5370e1aa-ac52-4ddb-89b9-0c2588db28be None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:06:48.255235 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5370e1aa-ac52-4ddb-89b9-0c2588db28be None admin] RBAC: Authorization granted {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:06:48.267501 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: [pid: 88550|app: 0|req: 351/687] 10.222.0.26 () {56 vars in 1109 bytes} [Wed Aug 17 19:06:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 19:06:48.272872 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca284647-315b-4ab7-8cf4-87f8da72e06a None admin] Authenticating user token {{(pid=88551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:06:48.326501 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG dbcounter [-] [88551] Writing DB stats keystone:SELECT=100 {{(pid=88551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:06:48.382598 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca284647-315b-4ab7-8cf4-87f8da72e06a None admin] Validating token access rules against request {{(pid=88551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:06:48.417391 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4565acc3-2aaf-45b4-bc5e-6da09cdcad86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '819d41a279e64291acc60de51e1530ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:06:48.418013 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4565acc3-2aaf-45b4-bc5e-6da09cdcad86 None admin] REQUEST_METHOD: `GET` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:06:48.418292 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4565acc3-2aaf-45b4-bc5e-6da09cdcad86 None admin] SCRIPT_NAME: `/identity` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:06:48.418578 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4565acc3-2aaf-45b4-bc5e-6da09cdcad86 None admin] PATH_INFO: `/v3/projects/service` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:06:48.425540 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4565acc3-2aaf-45b4-bc5e-6da09cdcad86 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:06:48.427005 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4565acc3-2aaf-45b4-bc5e-6da09cdcad86 None admin] RBAC: Authorization granted {{(pid=88551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:06:48.439951 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application [None req-4565acc3-2aaf-45b4-bc5e-6da09cdcad86 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 17 19:06:48.439951 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 19:06:48.439951 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 19:06:48.439951 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 19:06:48.439951 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 19:06:48.439951 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 19:06:48.439951 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 19:06:48.439951 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 19:06:48.439951 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 19:06:48.439951 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 19:06:48.439951 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 19:06:48.439951 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 19:06:48.439951 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 17 19:06:48.439951 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 17 19:06:48.439951 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 17 19:06:48.440881 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 17 19:06:48.440881 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 19:06:48.440881 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 19:06:48.440881 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 19:06:48.440881 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 19:06:48.440881 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 19:06:48.440881 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 19:06:48.440881 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 19:06:48.440881 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application with Lock( Aug 17 19:06:48.440881 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 19:06:48.440881 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application return self._enter() Aug 17 19:06:48.440881 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 19:06:48.440881 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 19:06:48.440881 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 19:06:48.440881 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application return self.creator() Aug 17 19:06:48.440881 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 19:06:48.440881 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application created_value = creator( Aug 17 19:06:48.442212 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 17 19:06:48.442212 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 17 19:06:48.442212 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 17 19:06:48.442212 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 17 19:06:48.442212 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 17 19:06:48.442212 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 17 19:06:48.442212 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 17 19:06:48.442212 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application Aug 17 19:06:48.442212 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: [pid: 88551|app: 0|req: 337/688] 10.222.0.26 () {56 vars in 1111 bytes} [Wed Aug 17 19:06:48 2022] GET /identity/v3/projects/service => generated 88 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 19:06:48.446815 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5370e1aa-ac52-4ddb-89b9-0c2588db28be None admin] Authenticating user token {{(pid=88550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:06:48.478912 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG dbcounter [-] [88550] Writing DB stats keystone:SELECT=100 {{(pid=88550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:06:48.548602 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5370e1aa-ac52-4ddb-89b9-0c2588db28be None admin] Validating token access rules against request {{(pid=88550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:06:48.584024 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-751d1be4-dfbc-421a-98b0-111da853c988 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '819d41a279e64291acc60de51e1530ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:06:48.584625 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-751d1be4-dfbc-421a-98b0-111da853c988 None admin] REQUEST_METHOD: `GET` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:06:48.584902 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-751d1be4-dfbc-421a-98b0-111da853c988 None admin] SCRIPT_NAME: `/identity` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:06:48.585172 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-751d1be4-dfbc-421a-98b0-111da853c988 None admin] PATH_INFO: `/v3/projects` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:06:48.585860 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-751d1be4-dfbc-421a-98b0-111da853c988 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88550) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 19:06:48.586160 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-751d1be4-dfbc-421a-98b0-111da853c988 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:06:48.587623 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-751d1be4-dfbc-421a-98b0-111da853c988 None admin] RBAC: Authorization granted {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:06:48.600521 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: [pid: 88550|app: 0|req: 352/689] 10.222.0.26 () {56 vars in 1148 bytes} [Wed Aug 17 19:06:48 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 19:06:48.606233 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4565acc3-2aaf-45b4-bc5e-6da09cdcad86 None admin] Authenticating user token {{(pid=88551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:06:48.726441 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4565acc3-2aaf-45b4-bc5e-6da09cdcad86 None admin] Validating token access rules against request {{(pid=88551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:06:48.736455 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG dbcounter [-] [88551] Writing DB stats keystone:SELECT=100 {{(pid=88551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:06:48.762655 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2c14ece-2742-4f7c-8fef-42a599331539 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '819d41a279e64291acc60de51e1530ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:06:48.763363 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c14ece-2742-4f7c-8fef-42a599331539 None admin] REQUEST_METHOD: `PUT` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:06:48.763645 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c14ece-2742-4f7c-8fef-42a599331539 None admin] SCRIPT_NAME: `/identity` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:06:48.763955 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c14ece-2742-4f7c-8fef-42a599331539 None admin] PATH_INFO: `/v3/projects/4bbf6c5abd684d899d09a08b0847d81c/users/9ae23e7a10d54989a25c9f3019184d01/roles/204f62ae18174b60a2e3f5d4f28ea326` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:06:48.765902 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2c14ece-2742-4f7c-8fef-42a599331539 None admin] RBAC: Authorizing `identity:create_grant(project_id=4bbf6c5abd684d899d09a08b0847d81c, user_id=9ae23e7a10d54989a25c9f3019184d01, role_id=204f62ae18174b60a2e3f5d4f28ea326)` {{(pid=88551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:06:48.767371 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2c14ece-2742-4f7c-8fef-42a599331539 None admin] RBAC: Authorization granted {{(pid=88551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:06:48.822346 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3830f418-d786-45aa-b35d-c329b1ab448d None None] REQUEST_METHOD: `GET` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:06:48.822913 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3830f418-d786-45aa-b35d-c329b1ab448d None None] SCRIPT_NAME: `/identity` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:06:48.822913 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3830f418-d786-45aa-b35d-c329b1ab448d None None] PATH_INFO: `/` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:06:48.824518 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: [pid: 88550|app: 0|req: 353/690] 10.222.0.26 () {54 vars in 927 bytes} [Wed Aug 17 19:06:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 19:06:48.829565 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d91f06f-29b7-40c1-8a6f-2d4fe9d34592 None None] REQUEST_METHOD: `POST` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:06:48.829961 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d91f06f-29b7-40c1-8a6f-2d4fe9d34592 None None] SCRIPT_NAME: `/identity` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:06:48.832651 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d91f06f-29b7-40c1-8a6f-2d4fe9d34592 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:06:48.849833 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.auth.core [None req-7d91f06f-29b7-40c1-8a6f-2d4fe9d34592 None None] MFA Rules not processed for user `819d41a279e64291acc60de51e1530ae`. Rule list: `[]` (Enabled: `True`). {{(pid=88550) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 19:06:48.851199 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.common.fernet_utils [None req-7d91f06f-29b7-40c1-8a6f-2d4fe9d34592 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:06:48.852925 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: [pid: 88551|app: 0|req: 338/691] 10.222.0.26 () {58 vars in 1439 bytes} [Wed Aug 17 19:06:48 2022] PUT /identity/v3/projects/4bbf6c5abd684d899d09a08b0847d81c/users/9ae23e7a10d54989a25c9f3019184d01/roles/204f62ae18174b60a2e3f5d4f28ea326 => generated 0 bytes in 247 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 19:06:48.937845 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: [pid: 88550|app: 0|req: 354/692] 10.222.0.26 () {58 vars in 1024 bytes} [Wed Aug 17 19:06:48 2022] POST /identity/v3/auth/tokens => generated 1098 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 17 19:06:49.235304 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4463389e-7d2f-4611-a5d2-6bfeda57e5c5 None None] REQUEST_METHOD: `GET` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:06:49.235821 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4463389e-7d2f-4611-a5d2-6bfeda57e5c5 None None] SCRIPT_NAME: `/identity` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:06:49.235821 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4463389e-7d2f-4611-a5d2-6bfeda57e5c5 None None] PATH_INFO: `/` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:06:49.237526 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: [pid: 88551|app: 0|req: 339/693] 10.222.0.26 () {54 vars in 927 bytes} [Wed Aug 17 19:06:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 19:06:49.242713 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b40867a2-1844-408d-a39f-665de15d4a81 None None] REQUEST_METHOD: `POST` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:06:49.243005 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b40867a2-1844-408d-a39f-665de15d4a81 None None] SCRIPT_NAME: `/identity` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:06:49.243283 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b40867a2-1844-408d-a39f-665de15d4a81 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:06:49.261891 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.auth.core [None req-b40867a2-1844-408d-a39f-665de15d4a81 None None] MFA Rules not processed for user `819d41a279e64291acc60de51e1530ae`. Rule list: `[]` (Enabled: `True`). {{(pid=88550) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 19:06:49.263160 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.common.fernet_utils [None req-b40867a2-1844-408d-a39f-665de15d4a81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:06:49.271340 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4463389e-7d2f-4611-a5d2-6bfeda57e5c5 None None] Authenticating user token {{(pid=88551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:06:49.281569 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG dbcounter [-] [88550] Writing DB stats keystone:SELECT=100 {{(pid=88550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:06:49.344131 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: [pid: 88550|app: 0|req: 355/694] 10.222.0.26 () {58 vars in 1024 bytes} [Wed Aug 17 19:06:49 2022] POST /identity/v3/auth/tokens => generated 1098 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 17 19:06:49.371104 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e0920e-2307-451b-837f-c166a8979945 None None] REQUEST_METHOD: `GET` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:06:49.371400 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e0920e-2307-451b-837f-c166a8979945 None None] SCRIPT_NAME: `/identity` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:06:49.371670 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e0920e-2307-451b-837f-c166a8979945 None None] PATH_INFO: `/` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:06:49.373673 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: [pid: 88550|app: 0|req: 356/695] 10.222.0.26 () {54 vars in 927 bytes} [Wed Aug 17 19:06:49 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 17 19:06:49.379228 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e31bb456-c916-44fd-be9b-fed35d453cb7 None None] REQUEST_METHOD: `POST` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:06:49.379739 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e31bb456-c916-44fd-be9b-fed35d453cb7 None None] SCRIPT_NAME: `/identity` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:06:49.380198 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e31bb456-c916-44fd-be9b-fed35d453cb7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:06:49.391499 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4463389e-7d2f-4611-a5d2-6bfeda57e5c5 None None] Validating token access rules against request {{(pid=88551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:06:49.400625 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.auth.core [None req-e31bb456-c916-44fd-be9b-fed35d453cb7 None None] MFA Rules not processed for user `819d41a279e64291acc60de51e1530ae`. Rule list: `[]` (Enabled: `True`). {{(pid=88550) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 19:06:49.401914 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.common.fernet_utils [None req-e31bb456-c916-44fd-be9b-fed35d453cb7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:06:49.427687 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb0330b5-3492-4350-a397-f72e6fe56854 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '819d41a279e64291acc60de51e1530ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:06:49.428309 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb0330b5-3492-4350-a397-f72e6fe56854 None admin] REQUEST_METHOD: `GET` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:06:49.428594 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb0330b5-3492-4350-a397-f72e6fe56854 None admin] SCRIPT_NAME: `/identity` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:06:49.428863 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb0330b5-3492-4350-a397-f72e6fe56854 None admin] PATH_INFO: `/v3/services/image` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:06:49.429445 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb0330b5-3492-4350-a397-f72e6fe56854 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=88551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:06:49.430820 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb0330b5-3492-4350-a397-f72e6fe56854 None admin] RBAC: Authorization granted {{(pid=88551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:06:49.441540 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application [None req-bb0330b5-3492-4350-a397-f72e6fe56854 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Aug 17 19:06:49.441540 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 19:06:49.441540 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 17 19:06:49.441540 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 17 19:06:49.441540 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 17 19:06:49.441540 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 17 19:06:49.441540 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 17 19:06:49.441540 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 17 19:06:49.441540 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 17 19:06:49.441540 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application Aug 17 19:06:49.441540 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 17 19:06:49.441540 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application Aug 17 19:06:49.441540 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 19:06:49.441540 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 19:06:49.441540 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 19:06:49.441540 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 19:06:49.441540 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 19:06:49.442643 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 19:06:49.442643 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 19:06:49.442643 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 19:06:49.442643 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 19:06:49.442643 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 19:06:49.442643 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 19:06:49.442643 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 17 19:06:49.442643 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 17 19:06:49.442643 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 17 19:06:49.442643 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 17 19:06:49.442643 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 19:06:49.442643 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 19:06:49.442643 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 19:06:49.442643 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 19:06:49.442643 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 19:06:49.442643 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 19:06:49.443714 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 19:06:49.443714 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application with Lock( Aug 17 19:06:49.443714 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 19:06:49.443714 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application return self._enter() Aug 17 19:06:49.443714 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 19:06:49.443714 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 19:06:49.443714 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 19:06:49.443714 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application return self.creator() Aug 17 19:06:49.443714 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 19:06:49.443714 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application created_value = creator( Aug 17 19:06:49.443714 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 17 19:06:49.443714 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 17 19:06:49.443714 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 17 19:06:49.443714 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application Aug 17 19:06:49.443714 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: [pid: 88551|app: 0|req: 340/696] 10.222.0.26 () {56 vars in 1105 bytes} [Wed Aug 17 19:06:49 2022] GET /identity/v3/services/image => generated 86 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 17 19:06:49.449932 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb0330b5-3492-4350-a397-f72e6fe56854 None admin] Authenticating user token {{(pid=88551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:06:49.482340 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG dbcounter [-] [88551] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:06:49.485751 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: [pid: 88550|app: 0|req: 357/697] 10.222.0.26 () {58 vars in 1024 bytes} [Wed Aug 17 19:06:49 2022] POST /identity/v3/auth/tokens => generated 1098 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 17 19:06:49.563999 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb0330b5-3492-4350-a397-f72e6fe56854 None admin] Validating token access rules against request {{(pid=88551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:06:49.599665 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6b8f8f4-13e8-49f9-b9aa-eb3fcbb13c5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '819d41a279e64291acc60de51e1530ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:06:49.600536 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b8f8f4-13e8-49f9-b9aa-eb3fcbb13c5d None admin] REQUEST_METHOD: `GET` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:06:49.600958 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b8f8f4-13e8-49f9-b9aa-eb3fcbb13c5d None admin] SCRIPT_NAME: `/identity` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:06:49.601393 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b8f8f4-13e8-49f9-b9aa-eb3fcbb13c5d None admin] PATH_INFO: `/v3/services` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:06:49.602159 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6b8f8f4-13e8-49f9-b9aa-eb3fcbb13c5d None admin] RBAC: Adding query filter params (name=image) {{(pid=88551) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 19:06:49.602651 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6b8f8f4-13e8-49f9-b9aa-eb3fcbb13c5d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:06:49.604198 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6b8f8f4-13e8-49f9-b9aa-eb3fcbb13c5d None admin] RBAC: Authorization granted {{(pid=88551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:06:49.610102 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: [pid: 88551|app: 0|req: 341/698] 10.222.0.26 () {56 vars in 1108 bytes} [Wed Aug 17 19:06:49 2022] GET /identity/v3/services?name=image => generated 122 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 17 19:06:49.615669 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e31bb456-c916-44fd-be9b-fed35d453cb7 None None] Authenticating user token {{(pid=88550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:06:49.698327 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG dbcounter [-] [88550] Writing DB stats keystone:SELECT=100 {{(pid=88550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:06:49.712514 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6b8f8f4-13e8-49f9-b9aa-eb3fcbb13c5d None admin] Authenticating user token {{(pid=88551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:06:49.719668 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e31bb456-c916-44fd-be9b-fed35d453cb7 None None] Validating token access rules against request {{(pid=88550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:06:49.755798 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28cf9100-b287-4847-85fc-69239a43a9f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '819d41a279e64291acc60de51e1530ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:06:49.756325 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28cf9100-b287-4847-85fc-69239a43a9f5 None admin] REQUEST_METHOD: `GET` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:06:49.756605 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28cf9100-b287-4847-85fc-69239a43a9f5 None admin] SCRIPT_NAME: `/identity` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:06:49.756878 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28cf9100-b287-4847-85fc-69239a43a9f5 None admin] PATH_INFO: `/v3/services` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:06:49.757509 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28cf9100-b287-4847-85fc-69239a43a9f5 None admin] RBAC: Adding query filter params (type=image) {{(pid=88550) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 19:06:49.757809 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28cf9100-b287-4847-85fc-69239a43a9f5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:06:49.759250 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28cf9100-b287-4847-85fc-69239a43a9f5 None admin] RBAC: Authorization granted {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:06:49.764341 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: [pid: 88550|app: 0|req: 358/699] 10.222.0.26 () {56 vars in 1108 bytes} [Wed Aug 17 19:06:49 2022] GET /identity/v3/services?type=image => generated 350 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 19:06:49.769877 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28cf9100-b287-4847-85fc-69239a43a9f5 None admin] Authenticating user token {{(pid=88550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:06:49.828550 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG dbcounter [-] [88551] Writing DB stats keystone:SELECT=100 {{(pid=88551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:06:49.835247 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6b8f8f4-13e8-49f9-b9aa-eb3fcbb13c5d None admin] Validating token access rules against request {{(pid=88551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:06:49.878205 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79a50b39-773a-4705-95d7-ac20d69e39cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '819d41a279e64291acc60de51e1530ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:06:49.878864 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a50b39-773a-4705-95d7-ac20d69e39cb None admin] REQUEST_METHOD: `GET` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:06:49.879138 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a50b39-773a-4705-95d7-ac20d69e39cb None admin] SCRIPT_NAME: `/identity` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:06:49.879412 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a50b39-773a-4705-95d7-ac20d69e39cb None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:06:49.880001 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79a50b39-773a-4705-95d7-ac20d69e39cb None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=88551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:06:49.881361 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79a50b39-773a-4705-95d7-ac20d69e39cb None admin] RBAC: Authorization granted {{(pid=88551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:06:49.883357 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28cf9100-b287-4847-85fc-69239a43a9f5 None admin] Validating token access rules against request {{(pid=88550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:06:49.890566 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application [None req-79a50b39-773a-4705-95d7-ac20d69e39cb None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 17 19:06:49.890566 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 19:06:49.890566 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 17 19:06:49.890566 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 17 19:06:49.890566 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 17 19:06:49.890566 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 17 19:06:49.890566 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 17 19:06:49.890566 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 17 19:06:49.890566 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 17 19:06:49.890566 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application Aug 17 19:06:49.890566 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 17 19:06:49.890566 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application Aug 17 19:06:49.890566 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 19:06:49.890566 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 19:06:49.890566 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 19:06:49.890566 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 19:06:49.890566 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 19:06:49.891770 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 19:06:49.891770 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 19:06:49.891770 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 19:06:49.891770 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 19:06:49.891770 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 19:06:49.891770 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 19:06:49.891770 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 17 19:06:49.891770 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 17 19:06:49.891770 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 17 19:06:49.891770 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 17 19:06:49.891770 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 19:06:49.891770 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 19:06:49.891770 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 19:06:49.891770 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 19:06:49.891770 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 19:06:49.891770 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 19:06:49.892654 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 19:06:49.892654 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application with Lock( Aug 17 19:06:49.892654 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 19:06:49.892654 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application return self._enter() Aug 17 19:06:49.892654 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 19:06:49.892654 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 19:06:49.892654 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 19:06:49.892654 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application return self.creator() Aug 17 19:06:49.892654 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 19:06:49.892654 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application created_value = creator( Aug 17 19:06:49.892654 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 17 19:06:49.892654 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 17 19:06:49.892654 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 17 19:06:49.892654 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application Aug 17 19:06:49.892654 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: [pid: 88551|app: 0|req: 342/700] 10.222.0.26 () {56 vars in 1129 bytes} [Wed Aug 17 19:06:49 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 17 19:06:49.893456 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79a50b39-773a-4705-95d7-ac20d69e39cb None admin] Authenticating user token {{(pid=88551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:06:49.925465 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a67dfc78-55b9-49fb-b9b7-9daa7a57ca23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '819d41a279e64291acc60de51e1530ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:06:49.926082 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a67dfc78-55b9-49fb-b9b7-9daa7a57ca23 None admin] REQUEST_METHOD: `GET` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:06:49.926359 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a67dfc78-55b9-49fb-b9b7-9daa7a57ca23 None admin] SCRIPT_NAME: `/identity` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:06:49.926666 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a67dfc78-55b9-49fb-b9b7-9daa7a57ca23 None admin] PATH_INFO: `/v3/endpoints` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:06:49.927364 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a67dfc78-55b9-49fb-b9b7-9daa7a57ca23 None admin] RBAC: Adding query filter params (interface=public, service_id=a7639eaa7d414bfba8e2f4d71ad6db89, region_id=RegionOne) {{(pid=88550) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 19:06:49.927672 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a67dfc78-55b9-49fb-b9b7-9daa7a57ca23 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:06:49.931260 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a67dfc78-55b9-49fb-b9b7-9daa7a57ca23 None admin] RBAC: Authorization granted {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:06:49.945843 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: [pid: 88550|app: 0|req: 359/701] 10.222.0.26 () {56 vars in 1251 bytes} [Wed Aug 17 19:06:49 2022] GET /identity/v3/endpoints?service_id=a7639eaa7d414bfba8e2f4d71ad6db89&interface=public®ion_id=RegionOne => generated 194 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 19:06:49.945843 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a67dfc78-55b9-49fb-b9b7-9daa7a57ca23 None admin] Authenticating user token {{(pid=88550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:06:49.959847 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG dbcounter [-] [88550] Writing DB stats keystone:SELECT=100 {{(pid=88550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:06:50.012100 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79a50b39-773a-4705-95d7-ac20d69e39cb None admin] Validating token access rules against request {{(pid=88551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:06:50.052407 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a8ee0bd-5970-42c8-b43d-7d3772db72a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '819d41a279e64291acc60de51e1530ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:06:50.053031 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a8ee0bd-5970-42c8-b43d-7d3772db72a3 None admin] REQUEST_METHOD: `GET` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:06:50.053314 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a8ee0bd-5970-42c8-b43d-7d3772db72a3 None admin] SCRIPT_NAME: `/identity` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:06:50.053589 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a8ee0bd-5970-42c8-b43d-7d3772db72a3 None admin] PATH_INFO: `/v3/services/network` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:06:50.054175 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a8ee0bd-5970-42c8-b43d-7d3772db72a3 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=88551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:06:50.055144 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a67dfc78-55b9-49fb-b9b7-9daa7a57ca23 None admin] Validating token access rules against request {{(pid=88550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:06:50.055585 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a8ee0bd-5970-42c8-b43d-7d3772db72a3 None admin] RBAC: Authorization granted {{(pid=88551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:06:50.066362 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application [None req-9a8ee0bd-5970-42c8-b43d-7d3772db72a3 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Aug 17 19:06:50.066362 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 19:06:50.066362 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 17 19:06:50.066362 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 17 19:06:50.066362 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 17 19:06:50.066362 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 17 19:06:50.066362 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 17 19:06:50.066362 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 17 19:06:50.066362 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 17 19:06:50.066362 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application Aug 17 19:06:50.066362 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 17 19:06:50.066362 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application Aug 17 19:06:50.066362 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 19:06:50.066362 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 19:06:50.066362 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 19:06:50.066362 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 19:06:50.066362 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 19:06:50.067601 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 19:06:50.067601 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 19:06:50.067601 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 19:06:50.067601 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 19:06:50.067601 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 19:06:50.067601 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 19:06:50.067601 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 17 19:06:50.067601 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 17 19:06:50.067601 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 17 19:06:50.067601 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 17 19:06:50.067601 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 19:06:50.067601 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 19:06:50.067601 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 19:06:50.067601 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 19:06:50.067601 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 19:06:50.067601 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 19:06:50.068459 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 19:06:50.068459 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application with Lock( Aug 17 19:06:50.068459 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 19:06:50.068459 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application return self._enter() Aug 17 19:06:50.068459 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 19:06:50.068459 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 19:06:50.068459 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 19:06:50.068459 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application return self.creator() Aug 17 19:06:50.068459 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 19:06:50.068459 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application created_value = creator( Aug 17 19:06:50.068459 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 17 19:06:50.068459 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 17 19:06:50.068459 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 17 19:06:50.068459 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application Aug 17 19:06:50.068459 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: [pid: 88551|app: 0|req: 343/702] 10.222.0.26 () {56 vars in 1111 bytes} [Wed Aug 17 19:06:49 2022] GET /identity/v3/services/network => generated 88 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 19:06:50.069262 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a8ee0bd-5970-42c8-b43d-7d3772db72a3 None admin] Authenticating user token {{(pid=88551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:06:50.093684 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd778fa5-ae8c-4898-8643-26ab819d3139 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '819d41a279e64291acc60de51e1530ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:06:50.094291 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd778fa5-ae8c-4898-8643-26ab819d3139 None admin] REQUEST_METHOD: `GET` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:06:50.094598 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd778fa5-ae8c-4898-8643-26ab819d3139 None admin] SCRIPT_NAME: `/identity` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:06:50.094881 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd778fa5-ae8c-4898-8643-26ab819d3139 None admin] PATH_INFO: `/v3/services` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:06:50.095544 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd778fa5-ae8c-4898-8643-26ab819d3139 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=88550) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 19:06:50.095849 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd778fa5-ae8c-4898-8643-26ab819d3139 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:06:50.097214 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd778fa5-ae8c-4898-8643-26ab819d3139 None admin] RBAC: Authorization granted {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:06:50.106413 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: [pid: 88550|app: 0|req: 360/703] 10.222.0.26 () {56 vars in 1124 bytes} [Wed Aug 17 19:06:49 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 19:06:50.106610 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG dbcounter [-] [88551] Writing DB stats keystone:SELECT=100 {{(pid=88551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:06:50.106708 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd778fa5-ae8c-4898-8643-26ab819d3139 None admin] Authenticating user token {{(pid=88550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:06:50.187407 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG dbcounter [-] [88550] Writing DB stats keystone:SELECT=100 {{(pid=88550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:06:50.202451 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a8ee0bd-5970-42c8-b43d-7d3772db72a3 None admin] Validating token access rules against request {{(pid=88551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:06:50.218099 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd778fa5-ae8c-4898-8643-26ab819d3139 None admin] Validating token access rules against request {{(pid=88550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:06:50.242781 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48bceb20-0e4d-4eed-a443-eac6e5e7c03d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '819d41a279e64291acc60de51e1530ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:06:50.243472 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48bceb20-0e4d-4eed-a443-eac6e5e7c03d None admin] REQUEST_METHOD: `GET` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:06:50.243678 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48bceb20-0e4d-4eed-a443-eac6e5e7c03d None admin] SCRIPT_NAME: `/identity` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:06:50.243984 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48bceb20-0e4d-4eed-a443-eac6e5e7c03d None admin] PATH_INFO: `/v3/services` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:06:50.244607 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48bceb20-0e4d-4eed-a443-eac6e5e7c03d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:06:50.246005 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48bceb20-0e4d-4eed-a443-eac6e5e7c03d None admin] RBAC: Authorization granted {{(pid=88551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:06:50.252316 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: [pid: 88551|app: 0|req: 344/704] 10.222.0.26 () {56 vars in 1087 bytes} [Wed Aug 17 19:06:50 2022] GET /identity/v3/services => generated 1002 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 19:06:50.257937 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8981f3b9-c44b-4f15-9d7b-89adcfadff4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '819d41a279e64291acc60de51e1530ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:06:50.258721 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48bceb20-0e4d-4eed-a443-eac6e5e7c03d None admin] Authenticating user token {{(pid=88551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:06:50.259221 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8981f3b9-c44b-4f15-9d7b-89adcfadff4e None admin] REQUEST_METHOD: `GET` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:06:50.259789 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8981f3b9-c44b-4f15-9d7b-89adcfadff4e None admin] SCRIPT_NAME: `/identity` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:06:50.260261 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8981f3b9-c44b-4f15-9d7b-89adcfadff4e None admin] PATH_INFO: `/v3/services` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:06:50.261102 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8981f3b9-c44b-4f15-9d7b-89adcfadff4e None admin] RBAC: Adding query filter params (name=network) {{(pid=88550) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 19:06:50.261618 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8981f3b9-c44b-4f15-9d7b-89adcfadff4e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:06:50.263611 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8981f3b9-c44b-4f15-9d7b-89adcfadff4e None admin] RBAC: Authorization granted {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:06:50.269692 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: [pid: 88550|app: 0|req: 361/705] 10.222.0.26 () {56 vars in 1112 bytes} [Wed Aug 17 19:06:50 2022] GET /identity/v3/services?name=network => generated 124 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 19:06:50.278403 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8981f3b9-c44b-4f15-9d7b-89adcfadff4e None admin] Authenticating user token {{(pid=88550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:06:50.371787 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG dbcounter [-] [88551] Writing DB stats keystone:SELECT=100 {{(pid=88551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:06:50.386333 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48bceb20-0e4d-4eed-a443-eac6e5e7c03d None admin] Validating token access rules against request {{(pid=88551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:06:50.427020 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10604972-b498-45d0-88d2-e36b6f47016d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '819d41a279e64291acc60de51e1530ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:06:50.427397 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8981f3b9-c44b-4f15-9d7b-89adcfadff4e None admin] Validating token access rules against request {{(pid=88550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:06:50.428238 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10604972-b498-45d0-88d2-e36b6f47016d None admin] REQUEST_METHOD: `GET` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:06:50.428753 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10604972-b498-45d0-88d2-e36b6f47016d None admin] SCRIPT_NAME: `/identity` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:06:50.429311 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10604972-b498-45d0-88d2-e36b6f47016d None admin] PATH_INFO: `/v3/services` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:06:50.430283 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10604972-b498-45d0-88d2-e36b6f47016d None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=88551) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 19:06:50.430821 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10604972-b498-45d0-88d2-e36b6f47016d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:06:50.432405 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10604972-b498-45d0-88d2-e36b6f47016d None admin] RBAC: Authorization granted {{(pid=88551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:06:50.439789 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: [pid: 88551|app: 0|req: 345/706] 10.222.0.26 () {56 vars in 1124 bytes} [Wed Aug 17 19:06:50 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 19:06:50.446581 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10604972-b498-45d0-88d2-e36b6f47016d None admin] Authenticating user token {{(pid=88551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:06:50.472316 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae09369a-7b39-4194-8b94-4ff0c8ff4d25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '819d41a279e64291acc60de51e1530ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:06:50.472929 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae09369a-7b39-4194-8b94-4ff0c8ff4d25 None admin] REQUEST_METHOD: `GET` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:06:50.473204 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae09369a-7b39-4194-8b94-4ff0c8ff4d25 None admin] SCRIPT_NAME: `/identity` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:06:50.473475 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae09369a-7b39-4194-8b94-4ff0c8ff4d25 None admin] PATH_INFO: `/v3/services` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:06:50.474100 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae09369a-7b39-4194-8b94-4ff0c8ff4d25 None admin] RBAC: Adding query filter params (type=network) {{(pid=88550) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 19:06:50.474427 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae09369a-7b39-4194-8b94-4ff0c8ff4d25 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:06:50.475847 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae09369a-7b39-4194-8b94-4ff0c8ff4d25 None admin] RBAC: Authorization granted {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:06:50.478192 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG dbcounter [-] [88550] Writing DB stats keystone:SELECT=100 {{(pid=88550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:06:50.481472 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: [pid: 88550|app: 0|req: 362/707] 10.222.0.26 () {56 vars in 1112 bytes} [Wed Aug 17 19:06:50 2022] GET /identity/v3/services?type=network => generated 350 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 19:06:50.488733 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae09369a-7b39-4194-8b94-4ff0c8ff4d25 None admin] Authenticating user token {{(pid=88550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:06:50.573269 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10604972-b498-45d0-88d2-e36b6f47016d None admin] Validating token access rules against request {{(pid=88551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:06:50.612889 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae09369a-7b39-4194-8b94-4ff0c8ff4d25 None admin] Validating token access rules against request {{(pid=88550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:06:50.615030 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e271db4f-1e22-4e5c-a4bf-b29e99a96bc1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '819d41a279e64291acc60de51e1530ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:06:50.616682 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e271db4f-1e22-4e5c-a4bf-b29e99a96bc1 None admin] REQUEST_METHOD: `GET` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:06:50.617228 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e271db4f-1e22-4e5c-a4bf-b29e99a96bc1 None admin] SCRIPT_NAME: `/identity` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:06:50.617523 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e271db4f-1e22-4e5c-a4bf-b29e99a96bc1 None admin] PATH_INFO: `/v3/endpoints` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:06:50.618241 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e271db4f-1e22-4e5c-a4bf-b29e99a96bc1 None admin] RBAC: Adding query filter params (interface=public, service_id=df83853bae6b47eb99e2387fcada146e, region_id=RegionOne) {{(pid=88551) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 19:06:50.618564 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e271db4f-1e22-4e5c-a4bf-b29e99a96bc1 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=88551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:06:50.619951 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e271db4f-1e22-4e5c-a4bf-b29e99a96bc1 None admin] RBAC: Authorization granted {{(pid=88551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:06:50.634570 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: [pid: 88551|app: 0|req: 346/708] 10.222.0.26 () {56 vars in 1251 bytes} [Wed Aug 17 19:06:50 2022] GET /identity/v3/endpoints?service_id=df83853bae6b47eb99e2387fcada146e&interface=public®ion_id=RegionOne => generated 194 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 19:06:50.641514 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e271db4f-1e22-4e5c-a4bf-b29e99a96bc1 None admin] Authenticating user token {{(pid=88551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:06:50.657361 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f218a042-542c-4624-865d-e7f6acdfe068 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '819d41a279e64291acc60de51e1530ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:06:50.658019 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f218a042-542c-4624-865d-e7f6acdfe068 None admin] REQUEST_METHOD: `GET` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:06:50.658349 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f218a042-542c-4624-865d-e7f6acdfe068 None admin] SCRIPT_NAME: `/identity` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:06:50.658649 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f218a042-542c-4624-865d-e7f6acdfe068 None admin] PATH_INFO: `/v3/endpoints` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:06:50.659348 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f218a042-542c-4624-865d-e7f6acdfe068 None admin] RBAC: Adding query filter params (interface=public, service_id=fffa5e7e5eff4c4293f94f42b9507521, region_id=RegionOne) {{(pid=88550) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 19:06:50.659653 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f218a042-542c-4624-865d-e7f6acdfe068 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:06:50.661083 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f218a042-542c-4624-865d-e7f6acdfe068 None admin] RBAC: Authorization granted {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:06:50.668645 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: [pid: 88550|app: 0|req: 363/709] 10.222.0.26 () {56 vars in 1251 bytes} [Wed Aug 17 19:06:50 2022] GET /identity/v3/endpoints?service_id=fffa5e7e5eff4c4293f94f42b9507521&interface=public®ion_id=RegionOne => generated 194 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 19:06:50.674398 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f218a042-542c-4624-865d-e7f6acdfe068 None admin] Authenticating user token {{(pid=88550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:06:50.683464 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG dbcounter [-] [88551] Writing DB stats keystone:SELECT=100 {{(pid=88551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:06:50.765652 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG dbcounter [-] [88550] Writing DB stats keystone:SELECT=100 {{(pid=88550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:06:50.773832 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e271db4f-1e22-4e5c-a4bf-b29e99a96bc1 None admin] Validating token access rules against request {{(pid=88551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:06:50.820207 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18ae2ff6-0db0-48d8-beca-8543ccb417b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '819d41a279e64291acc60de51e1530ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:06:50.821513 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ae2ff6-0db0-48d8-beca-8543ccb417b6 None admin] REQUEST_METHOD: `GET` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:06:50.821790 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ae2ff6-0db0-48d8-beca-8543ccb417b6 None admin] SCRIPT_NAME: `/identity` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:06:50.822057 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ae2ff6-0db0-48d8-beca-8543ccb417b6 None admin] PATH_INFO: `/v3/services` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:06:50.822804 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18ae2ff6-0db0-48d8-beca-8543ccb417b6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:06:50.824156 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18ae2ff6-0db0-48d8-beca-8543ccb417b6 None admin] RBAC: Authorization granted {{(pid=88551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:06:50.829283 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f218a042-542c-4624-865d-e7f6acdfe068 None admin] Validating token access rules against request {{(pid=88550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:06:50.835015 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: [pid: 88551|app: 0|req: 347/710] 10.222.0.26 () {56 vars in 1087 bytes} [Wed Aug 17 19:06:50 2022] GET /identity/v3/services => generated 1002 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 17 19:06:50.873141 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29ef9263-954c-41ba-a3dd-9a17a9d10f24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '819d41a279e64291acc60de51e1530ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:06:50.874477 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ef9263-954c-41ba-a3dd-9a17a9d10f24 None admin] REQUEST_METHOD: `GET` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:06:50.875012 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ef9263-954c-41ba-a3dd-9a17a9d10f24 None admin] SCRIPT_NAME: `/identity` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:06:50.875523 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ef9263-954c-41ba-a3dd-9a17a9d10f24 None admin] PATH_INFO: `/v3/services` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:06:50.876424 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29ef9263-954c-41ba-a3dd-9a17a9d10f24 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:06:50.878031 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29ef9263-954c-41ba-a3dd-9a17a9d10f24 None admin] RBAC: Authorization granted {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:06:50.887192 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: [pid: 88550|app: 0|req: 364/711] 10.222.0.26 () {56 vars in 1087 bytes} [Wed Aug 17 19:06:50 2022] GET /identity/v3/services => generated 1002 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 17 19:06:51.165962 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b5b9326-107a-4bd5-b70d-064aa769c6d5 None None] REQUEST_METHOD: `GET` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:06:51.166309 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b5b9326-107a-4bd5-b70d-064aa769c6d5 None None] SCRIPT_NAME: `/identity` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:06:51.166431 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b5b9326-107a-4bd5-b70d-064aa769c6d5 None None] PATH_INFO: `/` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:06:51.167934 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: [pid: 88551|app: 0|req: 348/712] 10.222.0.26 () {54 vars in 927 bytes} [Wed Aug 17 19:06:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 19:06:51.173964 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53527970-52d4-4ac1-a974-18400e5adfb0 None None] REQUEST_METHOD: `POST` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:06:51.174506 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53527970-52d4-4ac1-a974-18400e5adfb0 None None] SCRIPT_NAME: `/identity` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:06:51.175017 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53527970-52d4-4ac1-a974-18400e5adfb0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:06:51.195974 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.auth.core [None req-53527970-52d4-4ac1-a974-18400e5adfb0 None None] MFA Rules not processed for user `819d41a279e64291acc60de51e1530ae`. Rule list: `[]` (Enabled: `True`). {{(pid=88550) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 19:06:51.197534 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.common.fernet_utils [None req-53527970-52d4-4ac1-a974-18400e5adfb0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:06:51.276038 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: [pid: 88550|app: 0|req: 365/713] 10.222.0.26 () {58 vars in 1024 bytes} [Wed Aug 17 19:06:51 2022] POST /identity/v3/auth/tokens => generated 1098 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 17 19:06:51.609495 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b5b9326-107a-4bd5-b70d-064aa769c6d5 None None] Authenticating user token {{(pid=88551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:06:51.698320 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG dbcounter [-] [88551] Writing DB stats keystone:SELECT=100 {{(pid=88551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:06:51.719126 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b5b9326-107a-4bd5-b70d-064aa769c6d5 None None] Validating token access rules against request {{(pid=88551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:06:51.756981 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c381b7bd-8da8-4014-8d06-159408473486 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '819d41a279e64291acc60de51e1530ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:06:51.757716 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c381b7bd-8da8-4014-8d06-159408473486 None admin] REQUEST_METHOD: `GET` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:06:51.758132 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c381b7bd-8da8-4014-8d06-159408473486 None admin] SCRIPT_NAME: `/identity` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:06:51.758477 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c381b7bd-8da8-4014-8d06-159408473486 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:06:51.769077 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c381b7bd-8da8-4014-8d06-159408473486 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 17 19:06:51.775061 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application [None req-c381b7bd-8da8-4014-8d06-159408473486 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 17 19:06:51.775061 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 19:06:51.775061 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 19:06:51.775061 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 19:06:51.775061 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 19:06:51.775061 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 19:06:51.775061 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 19:06:51.775061 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 19:06:51.775061 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 19:06:51.775061 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 19:06:51.775061 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 19:06:51.775061 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 19:06:51.775061 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 17 19:06:51.775061 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 17 19:06:51.775061 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 17 19:06:51.775061 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 17 19:06:51.776162 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 17 19:06:51.776162 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 17 19:06:51.776162 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 17 19:06:51.776162 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 17 19:06:51.776162 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 19:06:51.776162 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 19:06:51.776162 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 19:06:51.776162 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 19:06:51.776162 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 19:06:51.776162 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 19:06:51.776162 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 19:06:51.776162 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application with Lock( Aug 17 19:06:51.776162 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 19:06:51.776162 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application return self._enter() Aug 17 19:06:51.776162 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 19:06:51.776162 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 19:06:51.777572 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 19:06:51.777572 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application return self.creator() Aug 17 19:06:51.777572 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 19:06:51.777572 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application created_value = creator( Aug 17 19:06:51.777572 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 17 19:06:51.777572 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 17 19:06:51.777572 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 17 19:06:51.777572 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 17 19:06:51.777572 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 17 19:06:51.777572 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 17 19:06:51.777572 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 17 19:06:51.777572 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application Aug 17 19:06:51.777572 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: [pid: 88551|app: 0|req: 349/714] 10.222.0.26 () {56 vars in 1096 bytes} [Wed Aug 17 19:06:51 2022] GET /identity/v3/roles/admin => generated 83 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 19:06:51.784783 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53527970-52d4-4ac1-a974-18400e5adfb0 None None] Authenticating user token {{(pid=88550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:06:51.850186 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG dbcounter [-] [88550] Writing DB stats keystone:SELECT=100 {{(pid=88550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:06:51.894610 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53527970-52d4-4ac1-a974-18400e5adfb0 None None] Validating token access rules against request {{(pid=88550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:06:51.932279 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c135ddd0-18b1-442e-abc5-d3341ba77765 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '819d41a279e64291acc60de51e1530ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:06:51.932896 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c135ddd0-18b1-442e-abc5-d3341ba77765 None admin] REQUEST_METHOD: `GET` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:06:51.933177 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c135ddd0-18b1-442e-abc5-d3341ba77765 None admin] SCRIPT_NAME: `/identity` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:06:51.933475 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c135ddd0-18b1-442e-abc5-d3341ba77765 None admin] PATH_INFO: `/v3/roles` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:06:51.934153 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c135ddd0-18b1-442e-abc5-d3341ba77765 None admin] RBAC: Adding query filter params (name=admin) {{(pid=88550) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 19:06:51.934507 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c135ddd0-18b1-442e-abc5-d3341ba77765 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:06:51.936364 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c135ddd0-18b1-442e-abc5-d3341ba77765 None admin] RBAC: Authorization granted {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:06:51.946730 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: [pid: 88550|app: 0|req: 366/715] 10.222.0.26 () {56 vars in 1099 bytes} [Wed Aug 17 19:06:51 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 19:06:51.953205 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c381b7bd-8da8-4014-8d06-159408473486 None admin] Authenticating user token {{(pid=88551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:06:52.067062 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c381b7bd-8da8-4014-8d06-159408473486 None admin] Validating token access rules against request {{(pid=88551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:06:52.106516 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54095f70-98cf-4175-b3a5-7f093fd13aae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '819d41a279e64291acc60de51e1530ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:06:52.108082 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54095f70-98cf-4175-b3a5-7f093fd13aae None admin] REQUEST_METHOD: `GET` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:06:52.108572 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54095f70-98cf-4175-b3a5-7f093fd13aae None admin] SCRIPT_NAME: `/identity` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:06:52.109091 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54095f70-98cf-4175-b3a5-7f093fd13aae None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:06:52.118783 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG dbcounter [-] [88551] Writing DB stats keystone:SELECT=100 {{(pid=88551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:06:52.121914 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54095f70-98cf-4175-b3a5-7f093fd13aae None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:06:52.123665 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54095f70-98cf-4175-b3a5-7f093fd13aae None admin] RBAC: Authorization granted {{(pid=88551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:06:52.138833 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application [None req-54095f70-98cf-4175-b3a5-7f093fd13aae None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 19:06:52.138833 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 19:06:52.138833 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 19:06:52.138833 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 19:06:52.138833 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 19:06:52.138833 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 19:06:52.138833 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 19:06:52.138833 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 19:06:52.138833 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 19:06:52.138833 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 19:06:52.138833 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 19:06:52.138833 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 19:06:52.138833 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 17 19:06:52.138833 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 17 19:06:52.138833 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 17 19:06:52.138833 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 17 19:06:52.139855 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 19:06:52.139855 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 19:06:52.139855 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 19:06:52.139855 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 19:06:52.139855 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 19:06:52.139855 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 19:06:52.139855 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 19:06:52.139855 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application with Lock( Aug 17 19:06:52.139855 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 19:06:52.139855 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application return self._enter() Aug 17 19:06:52.139855 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 19:06:52.139855 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 19:06:52.139855 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 19:06:52.139855 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application return self.creator() Aug 17 19:06:52.139855 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 19:06:52.139855 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application created_value = creator( Aug 17 19:06:52.139855 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 17 19:06:52.140783 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 17 19:06:52.140783 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 19:06:52.140783 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application Aug 17 19:06:52.146862 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: [pid: 88551|app: 0|req: 350/716] 10.222.0.26 () {56 vars in 1108 bytes} [Wed Aug 17 19:06:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 19:06:52.149122 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c135ddd0-18b1-442e-abc5-d3341ba77765 None admin] Authenticating user token {{(pid=88550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:06:52.269214 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c135ddd0-18b1-442e-abc5-d3341ba77765 None admin] Validating token access rules against request {{(pid=88550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:06:52.290286 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG dbcounter [-] [88550] Writing DB stats keystone:SELECT=100 {{(pid=88550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:06:52.305555 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bbadc3c-d1a8-4f8d-aa40-76933f8b29ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '819d41a279e64291acc60de51e1530ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:06:52.306169 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bbadc3c-d1a8-4f8d-aa40-76933f8b29ff None admin] REQUEST_METHOD: `GET` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:06:52.306473 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bbadc3c-d1a8-4f8d-aa40-76933f8b29ff None admin] SCRIPT_NAME: `/identity` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:06:52.306800 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bbadc3c-d1a8-4f8d-aa40-76933f8b29ff None admin] PATH_INFO: `/v3/domains` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:06:52.307450 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bbadc3c-d1a8-4f8d-aa40-76933f8b29ff None admin] RBAC: Adding query filter params (name=Default) {{(pid=88550) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 19:06:52.307757 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bbadc3c-d1a8-4f8d-aa40-76933f8b29ff None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:06:52.309168 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bbadc3c-d1a8-4f8d-aa40-76933f8b29ff None admin] RBAC: Authorization granted {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:06:52.322023 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: [pid: 88550|app: 0|req: 367/717] 10.222.0.26 () {56 vars in 1109 bytes} [Wed Aug 17 19:06:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 19:06:52.328184 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54095f70-98cf-4175-b3a5-7f093fd13aae None admin] Authenticating user token {{(pid=88551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:06:52.444033 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54095f70-98cf-4175-b3a5-7f093fd13aae None admin] Validating token access rules against request {{(pid=88551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:06:52.480620 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14b6036b-d54c-4536-9776-bf1a913d9c86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '819d41a279e64291acc60de51e1530ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:06:52.481342 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b6036b-d54c-4536-9776-bf1a913d9c86 None admin] REQUEST_METHOD: `GET` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:06:52.481703 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b6036b-d54c-4536-9776-bf1a913d9c86 None admin] SCRIPT_NAME: `/identity` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:06:52.482082 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b6036b-d54c-4536-9776-bf1a913d9c86 None admin] PATH_INFO: `/v3/users/nova` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:06:52.490065 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14b6036b-d54c-4536-9776-bf1a913d9c86 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=88551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:06:52.491605 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14b6036b-d54c-4536-9776-bf1a913d9c86 None admin] RBAC: Authorization granted {{(pid=88551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:06:52.503925 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application [None req-14b6036b-d54c-4536-9776-bf1a913d9c86 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 17 19:06:52.503925 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 19:06:52.503925 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 19:06:52.503925 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 19:06:52.503925 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 19:06:52.503925 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 19:06:52.503925 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 19:06:52.503925 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 19:06:52.503925 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 19:06:52.503925 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 19:06:52.503925 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 19:06:52.503925 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 19:06:52.503925 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 17 19:06:52.503925 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 17 19:06:52.503925 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 17 19:06:52.503925 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 17 19:06:52.505113 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 19:06:52.505113 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 19:06:52.505113 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 17 19:06:52.505113 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 17 19:06:52.505113 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 17 19:06:52.505113 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 17 19:06:52.505113 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 19:06:52.505113 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 19:06:52.505113 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 19:06:52.505113 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 19:06:52.505113 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 19:06:52.505113 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application with Lock( Aug 17 19:06:52.505113 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 19:06:52.505113 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application return self._enter() Aug 17 19:06:52.505113 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 19:06:52.505113 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 19:06:52.505113 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 19:06:52.505113 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application return self.creator() Aug 17 19:06:52.506326 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 19:06:52.506326 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application created_value = creator( Aug 17 19:06:52.506326 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 17 19:06:52.506326 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 17 19:06:52.506326 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 17 19:06:52.506326 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 17 19:06:52.506326 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 17 19:06:52.506326 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 17 19:06:52.506326 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 17 19:06:52.506326 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application Aug 17 19:06:52.507262 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: [pid: 88551|app: 0|req: 351/718] 10.222.0.26 () {56 vars in 1093 bytes} [Wed Aug 17 19:06:52 2022] GET /identity/v3/users/nova => generated 82 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 19:06:52.514037 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bbadc3c-d1a8-4f8d-aa40-76933f8b29ff None admin] Authenticating user token {{(pid=88550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:06:52.587565 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b55b7cd1-676a-4523-a908-84e16085d833 None None] REQUEST_METHOD: `GET` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:06:52.587876 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b55b7cd1-676a-4523-a908-84e16085d833 None None] SCRIPT_NAME: `/identity` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:06:52.588115 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b55b7cd1-676a-4523-a908-84e16085d833 None None] PATH_INFO: `/` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:06:52.589708 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: [pid: 88551|app: 0|req: 352/719] 10.222.0.26 () {54 vars in 927 bytes} [Wed Aug 17 19:06:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 17 19:06:52.595294 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-551673ec-5a97-48c8-93e6-ee5f2f3cf407 None None] REQUEST_METHOD: `POST` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:06:52.595589 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-551673ec-5a97-48c8-93e6-ee5f2f3cf407 None None] SCRIPT_NAME: `/identity` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:06:52.595845 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-551673ec-5a97-48c8-93e6-ee5f2f3cf407 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:06:52.615873 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.auth.core [None req-551673ec-5a97-48c8-93e6-ee5f2f3cf407 None None] MFA Rules not processed for user `819d41a279e64291acc60de51e1530ae`. Rule list: `[]` (Enabled: `True`). {{(pid=88551) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 19:06:52.617077 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.common.fernet_utils [None req-551673ec-5a97-48c8-93e6-ee5f2f3cf407 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:06:52.630199 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bbadc3c-d1a8-4f8d-aa40-76933f8b29ff None admin] Validating token access rules against request {{(pid=88550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:06:52.670385 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG dbcounter [-] [88551] Writing DB stats keystone:SELECT=100 {{(pid=88551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:06:52.674970 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f66da27-5438-4bf8-bdd6-914531c4510c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '819d41a279e64291acc60de51e1530ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:06:52.678367 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f66da27-5438-4bf8-bdd6-914531c4510c None admin] REQUEST_METHOD: `GET` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:06:52.678822 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f66da27-5438-4bf8-bdd6-914531c4510c None admin] SCRIPT_NAME: `/identity` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:06:52.679241 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f66da27-5438-4bf8-bdd6-914531c4510c None admin] PATH_INFO: `/v3/users` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:06:52.680120 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f66da27-5438-4bf8-bdd6-914531c4510c None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=88550) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 19:06:52.689894 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f66da27-5438-4bf8-bdd6-914531c4510c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:06:52.689894 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f66da27-5438-4bf8-bdd6-914531c4510c None admin] RBAC: Authorization granted {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:06:52.701153 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: [pid: 88551|app: 0|req: 353/720] 10.222.0.26 () {58 vars in 1024 bytes} [Wed Aug 17 19:06:52 2022] POST /identity/v3/auth/tokens => generated 1098 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 17 19:06:52.705304 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: [pid: 88550|app: 0|req: 368/721] 10.222.0.26 () {56 vars in 1133 bytes} [Wed Aug 17 19:06:52 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 19:06:52.711160 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-551673ec-5a97-48c8-93e6-ee5f2f3cf407 None None] Authenticating user token {{(pid=88551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:06:52.818120 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-551673ec-5a97-48c8-93e6-ee5f2f3cf407 None None] Validating token access rules against request {{(pid=88551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:06:52.854928 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72767824-0010-4df0-9ab6-7d325360744a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '819d41a279e64291acc60de51e1530ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:06:52.855539 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72767824-0010-4df0-9ab6-7d325360744a None admin] REQUEST_METHOD: `GET` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:06:52.855818 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72767824-0010-4df0-9ab6-7d325360744a None admin] SCRIPT_NAME: `/identity` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:06:52.856094 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72767824-0010-4df0-9ab6-7d325360744a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:06:52.910601 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG dbcounter [-] [88551] Writing DB stats keystone:SELECT=100 {{(pid=88551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:06:52.930994 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72767824-0010-4df0-9ab6-7d325360744a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:06:52.932523 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72767824-0010-4df0-9ab6-7d325360744a None admin] RBAC: Authorization granted {{(pid=88551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:06:53.049255 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f66da27-5438-4bf8-bdd6-914531c4510c None admin] Authenticating user token {{(pid=88550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:06:53.050579 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: [pid: 88551|app: 0|req: 354/722] 10.222.0.26 () {58 vars in 1282 bytes} [Wed Aug 17 19:06:52 2022] GET /identity/v3/auth/tokens => generated 1098 bytes in 336 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 17 19:06:53.052424 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72767824-0010-4df0-9ab6-7d325360744a None admin] Authenticating user token {{(pid=88551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:06:53.099803 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG dbcounter [-] [88550] Writing DB stats keystone:SELECT=100 {{(pid=88550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:06:53.164011 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f66da27-5438-4bf8-bdd6-914531c4510c None admin] Validating token access rules against request {{(pid=88550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:06:53.174196 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG dbcounter [-] [88551] Writing DB stats keystone:SELECT=100 {{(pid=88551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:06:53.196313 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72767824-0010-4df0-9ab6-7d325360744a None admin] Validating token access rules against request {{(pid=88551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:06:53.202372 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab7608f0-be2d-4298-988d-13765a970e76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '819d41a279e64291acc60de51e1530ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:06:53.203040 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab7608f0-be2d-4298-988d-13765a970e76 None admin] REQUEST_METHOD: `GET` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:06:53.203322 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab7608f0-be2d-4298-988d-13765a970e76 None admin] SCRIPT_NAME: `/identity` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:06:53.203594 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab7608f0-be2d-4298-988d-13765a970e76 None admin] PATH_INFO: `/v3/services/image` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:06:53.204263 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab7608f0-be2d-4298-988d-13765a970e76 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:06:53.205718 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab7608f0-be2d-4298-988d-13765a970e76 None admin] RBAC: Authorization granted {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:06:53.215323 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application [None req-ab7608f0-be2d-4298-988d-13765a970e76 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Aug 17 19:06:53.215323 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 19:06:53.215323 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 17 19:06:53.215323 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 17 19:06:53.215323 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 17 19:06:53.215323 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 17 19:06:53.215323 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 17 19:06:53.215323 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 17 19:06:53.215323 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 17 19:06:53.215323 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application Aug 17 19:06:53.215323 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 17 19:06:53.215323 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application Aug 17 19:06:53.215323 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 19:06:53.215323 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 19:06:53.215323 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 19:06:53.215323 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 19:06:53.215323 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 19:06:53.216469 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 19:06:53.216469 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 19:06:53.216469 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 19:06:53.216469 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 19:06:53.216469 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 19:06:53.216469 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 19:06:53.216469 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 17 19:06:53.216469 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 17 19:06:53.216469 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 17 19:06:53.216469 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 17 19:06:53.216469 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 19:06:53.216469 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 19:06:53.216469 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 19:06:53.216469 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 19:06:53.216469 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 19:06:53.216469 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 19:06:53.217314 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 19:06:53.217314 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application with Lock( Aug 17 19:06:53.217314 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 19:06:53.217314 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return self._enter() Aug 17 19:06:53.217314 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 19:06:53.217314 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 19:06:53.217314 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 19:06:53.217314 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return self.creator() Aug 17 19:06:53.217314 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 19:06:53.217314 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application created_value = creator( Aug 17 19:06:53.217314 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 17 19:06:53.217314 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 17 19:06:53.217314 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 17 19:06:53.217314 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application Aug 17 19:06:53.217314 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: [pid: 88550|app: 0|req: 369/723] 10.222.0.26 () {56 vars in 1105 bytes} [Wed Aug 17 19:06:53 2022] GET /identity/v3/services/image => generated 86 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 19:06:53.218123 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ead5357-2e3b-4b93-892f-a48d6729137c None None] REQUEST_METHOD: `GET` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:06:53.218123 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ead5357-2e3b-4b93-892f-a48d6729137c None None] SCRIPT_NAME: `/identity` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:06:53.219069 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ead5357-2e3b-4b93-892f-a48d6729137c None None] PATH_INFO: `/` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:06:53.219914 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: [pid: 88550|app: 0|req: 370/724] 10.222.0.26 () {54 vars in 927 bytes} [Wed Aug 17 19:06:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 19:06:53.224900 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ead5357-2e3b-4b93-892f-a48d6729137c None None] Authenticating user token {{(pid=88550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:06:53.243748 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cd56044-4428-4f4b-acd5-f3b989960767 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '819d41a279e64291acc60de51e1530ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:06:53.244399 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd56044-4428-4f4b-acd5-f3b989960767 None admin] REQUEST_METHOD: `GET` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:06:53.244682 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd56044-4428-4f4b-acd5-f3b989960767 None admin] SCRIPT_NAME: `/identity` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:06:53.244953 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd56044-4428-4f4b-acd5-f3b989960767 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:06:53.256998 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cd56044-4428-4f4b-acd5-f3b989960767 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:06:53.258440 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cd56044-4428-4f4b-acd5-f3b989960767 None admin] RBAC: Authorization granted {{(pid=88551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:06:53.274159 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application [None req-0cd56044-4428-4f4b-acd5-f3b989960767 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 19:06:53.274159 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 19:06:53.274159 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 19:06:53.274159 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 19:06:53.274159 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 19:06:53.274159 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 19:06:53.274159 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 19:06:53.274159 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 19:06:53.274159 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 19:06:53.274159 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 19:06:53.274159 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 19:06:53.274159 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 19:06:53.274159 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 17 19:06:53.274159 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 17 19:06:53.274159 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 17 19:06:53.274159 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 17 19:06:53.275222 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 19:06:53.275222 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 19:06:53.275222 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 19:06:53.275222 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 19:06:53.275222 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 19:06:53.275222 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 19:06:53.275222 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 19:06:53.275222 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application with Lock( Aug 17 19:06:53.275222 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 19:06:53.275222 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application return self._enter() Aug 17 19:06:53.275222 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 19:06:53.275222 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 19:06:53.275222 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 19:06:53.275222 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application return self.creator() Aug 17 19:06:53.275222 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 19:06:53.275222 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application created_value = creator( Aug 17 19:06:53.275222 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 17 19:06:53.276172 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 17 19:06:53.276172 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 19:06:53.276172 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application Aug 17 19:06:53.278707 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: [pid: 88551|app: 0|req: 355/725] 10.222.0.26 () {56 vars in 1108 bytes} [Wed Aug 17 19:06:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 17 19:06:53.280443 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c99d424-c146-4774-8126-2225b5a618b4 None None] REQUEST_METHOD: `POST` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:06:53.281136 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c99d424-c146-4774-8126-2225b5a618b4 None None] SCRIPT_NAME: `/identity` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:06:53.281425 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c99d424-c146-4774-8126-2225b5a618b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:06:53.300456 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.auth.core [None req-6c99d424-c146-4774-8126-2225b5a618b4 None None] MFA Rules not processed for user `819d41a279e64291acc60de51e1530ae`. Rule list: `[]` (Enabled: `True`). {{(pid=88551) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 19:06:53.301924 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.common.fernet_utils [None req-6c99d424-c146-4774-8126-2225b5a618b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:06:53.339023 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ead5357-2e3b-4b93-892f-a48d6729137c None None] Validating token access rules against request {{(pid=88550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:06:53.340555 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG dbcounter [-] [88550] Writing DB stats keystone:SELECT=100 {{(pid=88550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:06:53.375672 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: [pid: 88551|app: 0|req: 356/726] 10.222.0.26 () {58 vars in 1024 bytes} [Wed Aug 17 19:06:53 2022] POST /identity/v3/auth/tokens => generated 1098 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 17 19:06:53.376614 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c99d424-c146-4774-8126-2225b5a618b4 None None] Authenticating user token {{(pid=88551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:06:53.385733 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b42d4e8-ce29-4672-a719-edd14d71b8a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '819d41a279e64291acc60de51e1530ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:06:53.386487 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b42d4e8-ce29-4672-a719-edd14d71b8a1 None admin] REQUEST_METHOD: `GET` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:06:53.386794 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b42d4e8-ce29-4672-a719-edd14d71b8a1 None admin] SCRIPT_NAME: `/identity` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:06:53.387066 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b42d4e8-ce29-4672-a719-edd14d71b8a1 None admin] PATH_INFO: `/v3/services` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:06:53.387695 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b42d4e8-ce29-4672-a719-edd14d71b8a1 None admin] RBAC: Adding query filter params (name=image) {{(pid=88550) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 19:06:53.388025 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b42d4e8-ce29-4672-a719-edd14d71b8a1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:06:53.389455 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b42d4e8-ce29-4672-a719-edd14d71b8a1 None admin] RBAC: Authorization granted {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:06:53.398376 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: [pid: 88550|app: 0|req: 371/727] 10.222.0.26 () {56 vars in 1108 bytes} [Wed Aug 17 19:06:53 2022] GET /identity/v3/services?name=image => generated 122 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 19:06:53.399648 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd4fcda6-6d0c-4ad7-95ce-f7ad8e402b09 None None] REQUEST_METHOD: `GET` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:06:53.399937 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd4fcda6-6d0c-4ad7-95ce-f7ad8e402b09 None None] SCRIPT_NAME: `/identity` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:06:53.400209 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd4fcda6-6d0c-4ad7-95ce-f7ad8e402b09 None None] PATH_INFO: `/` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:06:53.401543 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: [pid: 88550|app: 0|req: 372/728] 10.222.0.26 () {54 vars in 927 bytes} [Wed Aug 17 19:06:53 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 19:06:53.406363 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd4fcda6-6d0c-4ad7-95ce-f7ad8e402b09 None None] Authenticating user token {{(pid=88550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:06:53.454307 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG dbcounter [-] [88551] Writing DB stats keystone:SELECT=100 {{(pid=88551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:06:53.495106 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c99d424-c146-4774-8126-2225b5a618b4 None None] Validating token access rules against request {{(pid=88551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:06:53.512109 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd4fcda6-6d0c-4ad7-95ce-f7ad8e402b09 None None] Validating token access rules against request {{(pid=88550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:06:53.531656 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7414941-0695-4643-b92d-a379204f4368 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '819d41a279e64291acc60de51e1530ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:06:53.532280 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7414941-0695-4643-b92d-a379204f4368 None admin] REQUEST_METHOD: `GET` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:06:53.532562 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7414941-0695-4643-b92d-a379204f4368 None admin] SCRIPT_NAME: `/identity` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:06:53.532837 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7414941-0695-4643-b92d-a379204f4368 None admin] PATH_INFO: `/v3/domains` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:06:53.533485 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7414941-0695-4643-b92d-a379204f4368 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88551) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 19:06:53.533793 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7414941-0695-4643-b92d-a379204f4368 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:06:53.535185 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7414941-0695-4643-b92d-a379204f4368 None admin] RBAC: Authorization granted {{(pid=88551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:06:53.549761 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: [pid: 88551|app: 0|req: 357/729] 10.222.0.26 () {56 vars in 1109 bytes} [Wed Aug 17 19:06:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 19:06:53.549761 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a7723db-a73d-4169-ae61-53d7538c0040 None None] REQUEST_METHOD: `POST` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:06:53.549761 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a7723db-a73d-4169-ae61-53d7538c0040 None None] SCRIPT_NAME: `/identity` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:06:53.549761 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a7723db-a73d-4169-ae61-53d7538c0040 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:06:53.554312 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b35b1d76-d122-4eb1-8c70-3f24cf101f62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '819d41a279e64291acc60de51e1530ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:06:53.554914 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35b1d76-d122-4eb1-8c70-3f24cf101f62 None admin] REQUEST_METHOD: `GET` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:06:53.555196 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35b1d76-d122-4eb1-8c70-3f24cf101f62 None admin] SCRIPT_NAME: `/identity` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:06:53.555469 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35b1d76-d122-4eb1-8c70-3f24cf101f62 None admin] PATH_INFO: `/v3/services` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:06:53.556336 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b35b1d76-d122-4eb1-8c70-3f24cf101f62 None admin] RBAC: Adding query filter params (type=image) {{(pid=88550) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 19:06:53.557547 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b35b1d76-d122-4eb1-8c70-3f24cf101f62 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:06:53.558950 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b35b1d76-d122-4eb1-8c70-3f24cf101f62 None admin] RBAC: Authorization granted {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:06:53.569434 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: [pid: 88550|app: 0|req: 373/730] 10.222.0.26 () {56 vars in 1108 bytes} [Wed Aug 17 19:06:53 2022] GET /identity/v3/services?type=image => generated 350 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 19:06:53.569434 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b35b1d76-d122-4eb1-8c70-3f24cf101f62 None admin] Authenticating user token {{(pid=88550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:06:53.569668 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.auth.core [None req-0a7723db-a73d-4169-ae61-53d7538c0040 None None] MFA Rules not processed for user `819d41a279e64291acc60de51e1530ae`. Rule list: `[]` (Enabled: `True`). {{(pid=88551) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 19:06:53.569668 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.common.fernet_utils [None req-0a7723db-a73d-4169-ae61-53d7538c0040 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:06:53.603640 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG dbcounter [-] [88550] Writing DB stats keystone:SELECT=100 {{(pid=88550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:06:53.643881 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: [pid: 88551|app: 0|req: 358/731] 10.222.0.26 () {58 vars in 1024 bytes} [Wed Aug 17 19:06:53 2022] POST /identity/v3/auth/tokens => generated 1098 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 17 19:06:53.644808 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a7723db-a73d-4169-ae61-53d7538c0040 None None] Authenticating user token {{(pid=88551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:06:53.679157 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b35b1d76-d122-4eb1-8c70-3f24cf101f62 None admin] Validating token access rules against request {{(pid=88550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:06:53.703085 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG dbcounter [-] [88551] Writing DB stats keystone:SELECT=100 {{(pid=88551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:06:53.714760 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3561455-5c2e-4224-89f3-74e02722b872 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '819d41a279e64291acc60de51e1530ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:06:53.715429 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3561455-5c2e-4224-89f3-74e02722b872 None admin] REQUEST_METHOD: `GET` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:06:53.715705 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3561455-5c2e-4224-89f3-74e02722b872 None admin] SCRIPT_NAME: `/identity` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:06:53.715978 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3561455-5c2e-4224-89f3-74e02722b872 None admin] PATH_INFO: `/v3/projects/service` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:06:53.723313 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3561455-5c2e-4224-89f3-74e02722b872 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:06:53.724772 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3561455-5c2e-4224-89f3-74e02722b872 None admin] RBAC: Authorization granted {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:06:53.737454 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application [None req-b3561455-5c2e-4224-89f3-74e02722b872 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 17 19:06:53.737454 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 19:06:53.737454 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 19:06:53.737454 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 19:06:53.737454 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 19:06:53.737454 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 19:06:53.737454 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 19:06:53.737454 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 19:06:53.737454 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 19:06:53.737454 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 19:06:53.737454 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 19:06:53.737454 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 19:06:53.737454 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 17 19:06:53.737454 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 17 19:06:53.737454 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 17 19:06:53.738592 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 17 19:06:53.738592 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 19:06:53.738592 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 19:06:53.738592 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 19:06:53.738592 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 19:06:53.738592 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 19:06:53.738592 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 19:06:53.738592 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 19:06:53.738592 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application with Lock( Aug 17 19:06:53.738592 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 19:06:53.738592 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return self._enter() Aug 17 19:06:53.738592 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 19:06:53.738592 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 19:06:53.738592 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 19:06:53.738592 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return self.creator() Aug 17 19:06:53.738592 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 19:06:53.738592 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application created_value = creator( Aug 17 19:06:53.739737 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 17 19:06:53.739737 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 17 19:06:53.739737 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 17 19:06:53.739737 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 17 19:06:53.739737 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 17 19:06:53.739737 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 17 19:06:53.739737 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 17 19:06:53.739737 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application Aug 17 19:06:53.742718 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: [pid: 88550|app: 0|req: 374/732] 10.222.0.26 () {56 vars in 1111 bytes} [Wed Aug 17 19:06:53 2022] GET /identity/v3/projects/service => generated 88 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 19:06:53.743537 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3561455-5c2e-4224-89f3-74e02722b872 None admin] Authenticating user token {{(pid=88550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:06:53.757707 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a7723db-a73d-4169-ae61-53d7538c0040 None None] Validating token access rules against request {{(pid=88551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:06:53.799643 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a7aba61-aa16-4c7c-9deb-3b720f86b238 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '819d41a279e64291acc60de51e1530ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:06:53.800564 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a7aba61-aa16-4c7c-9deb-3b720f86b238 None admin] REQUEST_METHOD: `POST` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:06:53.801010 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a7aba61-aa16-4c7c-9deb-3b720f86b238 None admin] SCRIPT_NAME: `/identity` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:06:53.801436 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a7aba61-aa16-4c7c-9deb-3b720f86b238 None admin] PATH_INFO: `/v3/endpoints` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:06:53.802284 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a7aba61-aa16-4c7c-9deb-3b720f86b238 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=88551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:06:53.804013 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a7aba61-aa16-4c7c-9deb-3b720f86b238 None admin] RBAC: Authorization granted {{(pid=88551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:06:53.953828 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: [pid: 88551|app: 0|req: 359/733] 10.222.0.26 () {60 vars in 1144 bytes} [Wed Aug 17 19:06:53 2022] POST /identity/v3/endpoints => generated 327 bytes in 309 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 19:06:53.954854 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a7aba61-aa16-4c7c-9deb-3b720f86b238 None admin] Authenticating user token {{(pid=88551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:06:53.967484 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG dbcounter [-] [88550] Writing DB stats keystone:SELECT=100 {{(pid=88550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:06:53.980814 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3561455-5c2e-4224-89f3-74e02722b872 None admin] Validating token access rules against request {{(pid=88550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:06:54.024477 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db555e81-2bf9-4e55-8e4f-2a4bfcfb3153 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '819d41a279e64291acc60de51e1530ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:06:54.025161 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db555e81-2bf9-4e55-8e4f-2a4bfcfb3153 None admin] REQUEST_METHOD: `GET` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:06:54.025451 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db555e81-2bf9-4e55-8e4f-2a4bfcfb3153 None admin] SCRIPT_NAME: `/identity` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:06:54.025725 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db555e81-2bf9-4e55-8e4f-2a4bfcfb3153 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:06:54.026319 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db555e81-2bf9-4e55-8e4f-2a4bfcfb3153 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:06:54.027857 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db555e81-2bf9-4e55-8e4f-2a4bfcfb3153 None admin] RBAC: Authorization granted {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:06:54.038659 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application [None req-db555e81-2bf9-4e55-8e4f-2a4bfcfb3153 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 17 19:06:54.038659 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 19:06:54.038659 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 17 19:06:54.038659 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 17 19:06:54.038659 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 17 19:06:54.038659 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 17 19:06:54.038659 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 17 19:06:54.038659 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 17 19:06:54.038659 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 17 19:06:54.038659 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application Aug 17 19:06:54.038659 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 17 19:06:54.038659 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application Aug 17 19:06:54.038659 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 19:06:54.038659 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 19:06:54.038659 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 19:06:54.038659 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 19:06:54.038659 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 19:06:54.045818 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 19:06:54.045818 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 19:06:54.045818 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 19:06:54.045818 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 19:06:54.045818 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 19:06:54.045818 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 19:06:54.045818 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 17 19:06:54.045818 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 17 19:06:54.045818 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 17 19:06:54.045818 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 17 19:06:54.045818 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 19:06:54.045818 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 19:06:54.045818 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 19:06:54.045818 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 19:06:54.045818 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 19:06:54.045818 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 19:06:54.046725 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 19:06:54.046725 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application with Lock( Aug 17 19:06:54.046725 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 19:06:54.046725 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return self._enter() Aug 17 19:06:54.046725 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 19:06:54.046725 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 19:06:54.046725 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 19:06:54.046725 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return self.creator() Aug 17 19:06:54.046725 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 19:06:54.046725 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application created_value = creator( Aug 17 19:06:54.046725 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 17 19:06:54.046725 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 17 19:06:54.046725 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 17 19:06:54.046725 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application Aug 17 19:06:54.046725 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: [pid: 88550|app: 0|req: 375/734] 10.222.0.26 () {56 vars in 1129 bytes} [Wed Aug 17 19:06:53 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 297 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 19:06:54.047561 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db555e81-2bf9-4e55-8e4f-2a4bfcfb3153 None admin] Authenticating user token {{(pid=88550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:06:54.095837 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a7aba61-aa16-4c7c-9deb-3b720f86b238 None admin] Validating token access rules against request {{(pid=88551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:06:54.109056 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG dbcounter [-] [88551] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:06:54.134718 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b71d903-b472-40ea-8c53-fa2041b8846f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '819d41a279e64291acc60de51e1530ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:06:54.135447 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b71d903-b472-40ea-8c53-fa2041b8846f None admin] REQUEST_METHOD: `GET` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:06:54.135730 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b71d903-b472-40ea-8c53-fa2041b8846f None admin] SCRIPT_NAME: `/identity` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:06:54.136005 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b71d903-b472-40ea-8c53-fa2041b8846f None admin] PATH_INFO: `/v3/projects` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:06:54.136751 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b71d903-b472-40ea-8c53-fa2041b8846f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88551) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 19:06:54.137057 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b71d903-b472-40ea-8c53-fa2041b8846f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:06:54.139516 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b71d903-b472-40ea-8c53-fa2041b8846f None admin] RBAC: Authorization granted {{(pid=88551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:06:54.151478 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: [pid: 88551|app: 0|req: 360/735] 10.222.0.26 () {56 vars in 1148 bytes} [Wed Aug 17 19:06:53 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 19:06:54.152301 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b71d903-b472-40ea-8c53-fa2041b8846f None admin] Authenticating user token {{(pid=88551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:06:54.162342 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db555e81-2bf9-4e55-8e4f-2a4bfcfb3153 None admin] Validating token access rules against request {{(pid=88550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:06:54.204013 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-360819eb-8798-4bd8-9da9-07cbaeb95e7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '819d41a279e64291acc60de51e1530ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:06:54.204697 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-360819eb-8798-4bd8-9da9-07cbaeb95e7b None admin] REQUEST_METHOD: `GET` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:06:54.204979 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-360819eb-8798-4bd8-9da9-07cbaeb95e7b None admin] SCRIPT_NAME: `/identity` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:06:54.205251 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-360819eb-8798-4bd8-9da9-07cbaeb95e7b None admin] PATH_INFO: `/v3/services/network` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:06:54.205838 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-360819eb-8798-4bd8-9da9-07cbaeb95e7b None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:06:54.207243 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-360819eb-8798-4bd8-9da9-07cbaeb95e7b None admin] RBAC: Authorization granted {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:06:54.216763 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application [None req-360819eb-8798-4bd8-9da9-07cbaeb95e7b None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Aug 17 19:06:54.216763 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 19:06:54.216763 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 17 19:06:54.216763 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 17 19:06:54.216763 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 17 19:06:54.216763 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 17 19:06:54.216763 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 17 19:06:54.216763 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 17 19:06:54.216763 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 17 19:06:54.216763 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application Aug 17 19:06:54.216763 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 17 19:06:54.216763 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application Aug 17 19:06:54.216763 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 19:06:54.216763 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 19:06:54.216763 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 19:06:54.216763 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 19:06:54.216763 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 19:06:54.217779 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 19:06:54.217779 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 19:06:54.217779 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 19:06:54.217779 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 19:06:54.217779 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 19:06:54.217779 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 19:06:54.217779 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 17 19:06:54.217779 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 17 19:06:54.217779 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 17 19:06:54.217779 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 17 19:06:54.217779 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 19:06:54.217779 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 19:06:54.217779 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 19:06:54.217779 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 19:06:54.217779 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 19:06:54.217779 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 19:06:54.218691 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 19:06:54.218691 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application with Lock( Aug 17 19:06:54.218691 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 19:06:54.218691 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return self._enter() Aug 17 19:06:54.218691 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 19:06:54.218691 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 19:06:54.218691 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 19:06:54.218691 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return self.creator() Aug 17 19:06:54.218691 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 19:06:54.218691 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application created_value = creator( Aug 17 19:06:54.218691 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 17 19:06:54.218691 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 17 19:06:54.218691 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 17 19:06:54.218691 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application Aug 17 19:06:54.218691 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: [pid: 88550|app: 0|req: 376/736] 10.222.0.26 () {56 vars in 1111 bytes} [Wed Aug 17 19:06:54 2022] GET /identity/v3/services/network => generated 88 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 19:06:54.220500 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-360819eb-8798-4bd8-9da9-07cbaeb95e7b None admin] Authenticating user token {{(pid=88550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:06:54.238233 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG dbcounter [-] [88550] Writing DB stats keystone:SELECT=100 {{(pid=88550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:06:54.274659 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b71d903-b472-40ea-8c53-fa2041b8846f None admin] Validating token access rules against request {{(pid=88551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:06:54.310762 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-635fa4b4-bc76-4334-bb89-77c93699f30d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '819d41a279e64291acc60de51e1530ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:06:54.311627 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-635fa4b4-bc76-4334-bb89-77c93699f30d None admin] REQUEST_METHOD: `GET` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:06:54.311909 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-635fa4b4-bc76-4334-bb89-77c93699f30d None admin] SCRIPT_NAME: `/identity` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:06:54.312180 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-635fa4b4-bc76-4334-bb89-77c93699f30d None admin] PATH_INFO: `/v3/services` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:06:54.312856 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-635fa4b4-bc76-4334-bb89-77c93699f30d None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=88551) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 19:06:54.313169 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-635fa4b4-bc76-4334-bb89-77c93699f30d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:06:54.314524 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-635fa4b4-bc76-4334-bb89-77c93699f30d None admin] RBAC: Authorization granted {{(pid=88551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:06:54.323726 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: [pid: 88551|app: 0|req: 361/737] 10.222.0.26 () {56 vars in 1124 bytes} [Wed Aug 17 19:06:54 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 19:06:54.323726 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-635fa4b4-bc76-4334-bb89-77c93699f30d None admin] Authenticating user token {{(pid=88551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:06:54.332676 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-360819eb-8798-4bd8-9da9-07cbaeb95e7b None admin] Validating token access rules against request {{(pid=88550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:06:54.355978 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG dbcounter [-] [88551] Writing DB stats keystone:SELECT=100 {{(pid=88551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:06:54.369275 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4276c7a-bf4b-497e-a508-ab1603595ebf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '819d41a279e64291acc60de51e1530ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:06:54.369883 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4276c7a-bf4b-497e-a508-ab1603595ebf None admin] REQUEST_METHOD: `GET` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:06:54.370184 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4276c7a-bf4b-497e-a508-ab1603595ebf None admin] SCRIPT_NAME: `/identity` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:06:54.370458 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4276c7a-bf4b-497e-a508-ab1603595ebf None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:06:54.371208 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4276c7a-bf4b-497e-a508-ab1603595ebf None admin] RBAC: Adding query filter params (role.id=204f62ae18174b60a2e3f5d4f28ea326, scope.project.id=4bbf6c5abd684d899d09a08b0847d81c, user.id=9ae23e7a10d54989a25c9f3019184d01) {{(pid=88550) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 19:06:54.371515 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4276c7a-bf4b-497e-a508-ab1603595ebf None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:06:54.373481 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4276c7a-bf4b-497e-a508-ab1603595ebf None admin] RBAC: Authorization granted {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:06:54.390954 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: [pid: 88550|app: 0|req: 377/738] 10.222.0.26 () {56 vars in 1374 bytes} [Wed Aug 17 19:06:54 2022] GET /identity/v3/role_assignments?user.id=9ae23e7a10d54989a25c9f3019184d01&scope.project.id=4bbf6c5abd684d899d09a08b0847d81c&role.id=204f62ae18174b60a2e3f5d4f28ea326 => generated 608 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 19:06:54.392094 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4276c7a-bf4b-497e-a508-ab1603595ebf None admin] Authenticating user token {{(pid=88550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:06:54.435862 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-635fa4b4-bc76-4334-bb89-77c93699f30d None admin] Validating token access rules against request {{(pid=88551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:06:54.479134 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1cf9fa5-25a4-4fca-8558-ed3a3ad59e07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '819d41a279e64291acc60de51e1530ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:06:54.480000 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1cf9fa5-25a4-4fca-8558-ed3a3ad59e07 None admin] REQUEST_METHOD: `GET` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:06:54.480425 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1cf9fa5-25a4-4fca-8558-ed3a3ad59e07 None admin] SCRIPT_NAME: `/identity` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:06:54.480940 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1cf9fa5-25a4-4fca-8558-ed3a3ad59e07 None admin] PATH_INFO: `/v3/services` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:06:54.481817 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1cf9fa5-25a4-4fca-8558-ed3a3ad59e07 None admin] RBAC: Adding query filter params (name=network) {{(pid=88551) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 19:06:54.482319 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1cf9fa5-25a4-4fca-8558-ed3a3ad59e07 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:06:54.484169 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1cf9fa5-25a4-4fca-8558-ed3a3ad59e07 None admin] RBAC: Authorization granted {{(pid=88551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:06:54.491197 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: [pid: 88551|app: 0|req: 362/739] 10.222.0.26 () {56 vars in 1112 bytes} [Wed Aug 17 19:06:54 2022] GET /identity/v3/services?name=network => generated 124 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 19:06:54.496654 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1cf9fa5-25a4-4fca-8558-ed3a3ad59e07 None admin] Authenticating user token {{(pid=88551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:06:54.519365 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG dbcounter [-] [88550] Writing DB stats keystone:SELECT=100 {{(pid=88550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:06:54.543476 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4276c7a-bf4b-497e-a508-ab1603595ebf None admin] Validating token access rules against request {{(pid=88550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:06:54.590162 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08ddd2d6-5443-4a13-a282-08a33bec8465 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '819d41a279e64291acc60de51e1530ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:06:54.591868 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ddd2d6-5443-4a13-a282-08a33bec8465 None admin] REQUEST_METHOD: `GET` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:06:54.591868 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ddd2d6-5443-4a13-a282-08a33bec8465 None admin] SCRIPT_NAME: `/identity` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:06:54.592074 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ddd2d6-5443-4a13-a282-08a33bec8465 None admin] PATH_INFO: `/v3/services` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:06:54.592673 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08ddd2d6-5443-4a13-a282-08a33bec8465 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=88550) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 19:06:54.592848 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08ddd2d6-5443-4a13-a282-08a33bec8465 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:06:54.594303 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08ddd2d6-5443-4a13-a282-08a33bec8465 None admin] RBAC: Authorization granted {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:06:54.600947 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: [pid: 88550|app: 0|req: 378/740] 10.222.0.26 () {56 vars in 1124 bytes} [Wed Aug 17 19:06:54 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 19:06:54.606521 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08ddd2d6-5443-4a13-a282-08a33bec8465 None admin] Authenticating user token {{(pid=88550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:06:54.623093 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG dbcounter [-] [88551] Writing DB stats keystone:SELECT=100 {{(pid=88551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:06:54.630170 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1cf9fa5-25a4-4fca-8558-ed3a3ad59e07 None admin] Validating token access rules against request {{(pid=88551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:06:54.683442 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06455101-ca28-48e9-af9c-5ba6c345f0cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '819d41a279e64291acc60de51e1530ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:06:54.684221 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06455101-ca28-48e9-af9c-5ba6c345f0cb None admin] REQUEST_METHOD: `GET` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:06:54.684595 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06455101-ca28-48e9-af9c-5ba6c345f0cb None admin] SCRIPT_NAME: `/identity` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:06:54.685571 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06455101-ca28-48e9-af9c-5ba6c345f0cb None admin] PATH_INFO: `/v3/services` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:06:54.686574 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06455101-ca28-48e9-af9c-5ba6c345f0cb None admin] RBAC: Adding query filter params (type=network) {{(pid=88551) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 19:06:54.686975 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06455101-ca28-48e9-af9c-5ba6c345f0cb None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:06:54.688438 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06455101-ca28-48e9-af9c-5ba6c345f0cb None admin] RBAC: Authorization granted {{(pid=88551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:06:54.698609 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: [pid: 88551|app: 0|req: 363/741] 10.222.0.26 () {56 vars in 1112 bytes} [Wed Aug 17 19:06:54 2022] GET /identity/v3/services?type=network => generated 350 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 17 19:06:54.709427 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06455101-ca28-48e9-af9c-5ba6c345f0cb None admin] Authenticating user token {{(pid=88551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:06:54.733546 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08ddd2d6-5443-4a13-a282-08a33bec8465 None admin] Validating token access rules against request {{(pid=88550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:06:54.773478 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d609d58c-d9dc-4a22-8f07-3285e513d784 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '819d41a279e64291acc60de51e1530ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:06:54.774080 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d609d58c-d9dc-4a22-8f07-3285e513d784 None admin] REQUEST_METHOD: `POST` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:06:54.774367 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d609d58c-d9dc-4a22-8f07-3285e513d784 None admin] SCRIPT_NAME: `/identity` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:06:54.774696 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d609d58c-d9dc-4a22-8f07-3285e513d784 None admin] PATH_INFO: `/v3/endpoints` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:06:54.775375 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d609d58c-d9dc-4a22-8f07-3285e513d784 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:06:54.777042 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d609d58c-d9dc-4a22-8f07-3285e513d784 None admin] RBAC: Authorization granted {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:06:54.817814 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06455101-ca28-48e9-af9c-5ba6c345f0cb None admin] Validating token access rules against request {{(pid=88551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:06:54.853768 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fa5af15-ed6c-4b8e-84b2-2601e8fb98e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '819d41a279e64291acc60de51e1530ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:06:54.854372 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa5af15-ed6c-4b8e-84b2-2601e8fb98e3 None admin] REQUEST_METHOD: `POST` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:06:54.854685 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa5af15-ed6c-4b8e-84b2-2601e8fb98e3 None admin] SCRIPT_NAME: `/identity` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:06:54.854962 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa5af15-ed6c-4b8e-84b2-2601e8fb98e3 None admin] PATH_INFO: `/v3/endpoints` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:06:54.855665 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fa5af15-ed6c-4b8e-84b2-2601e8fb98e3 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=88551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:06:54.858581 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG dbcounter [-] [88550] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:06:54.861098 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fa5af15-ed6c-4b8e-84b2-2601e8fb98e3 None admin] RBAC: Authorization granted {{(pid=88551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:06:54.870868 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: [pid: 88550|app: 0|req: 379/742] 10.222.0.26 () {60 vars in 1144 bytes} [Wed Aug 17 19:06:54 2022] POST /identity/v3/endpoints => generated 346 bytes in 259 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 17 19:06:54.979346 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: [pid: 88551|app: 0|req: 364/743] 10.222.0.26 () {60 vars in 1144 bytes} [Wed Aug 17 19:06:54 2022] POST /identity/v3/endpoints => generated 337 bytes in 270 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 19:06:56.222527 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-974a06d8-7860-4dfc-bd40-ba88f6e22cdf None None] REQUEST_METHOD: `GET` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:06:56.223057 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-974a06d8-7860-4dfc-bd40-ba88f6e22cdf None None] SCRIPT_NAME: `/identity` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:06:56.223057 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-974a06d8-7860-4dfc-bd40-ba88f6e22cdf None None] PATH_INFO: `/` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:06:56.224365 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: [pid: 88550|app: 0|req: 380/744] 10.222.0.26 () {54 vars in 927 bytes} [Wed Aug 17 19:06:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 19:06:56.230477 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-479f8c2e-dd0a-4d8f-86f7-cea256215de5 None None] REQUEST_METHOD: `POST` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:06:56.231035 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-479f8c2e-dd0a-4d8f-86f7-cea256215de5 None None] SCRIPT_NAME: `/identity` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:06:56.231035 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-479f8c2e-dd0a-4d8f-86f7-cea256215de5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:06:56.250346 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.auth.core [None req-479f8c2e-dd0a-4d8f-86f7-cea256215de5 None None] MFA Rules not processed for user `819d41a279e64291acc60de51e1530ae`. Rule list: `[]` (Enabled: `True`). {{(pid=88551) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 19:06:56.251592 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.common.fernet_utils [None req-479f8c2e-dd0a-4d8f-86f7-cea256215de5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:06:56.268567 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG dbcounter [-] [88551] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:06:56.336448 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: [pid: 88551|app: 0|req: 365/745] 10.222.0.26 () {58 vars in 1024 bytes} [Wed Aug 17 19:06:56 2022] POST /identity/v3/auth/tokens => generated 1406 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 17 19:06:56.665043 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-974a06d8-7860-4dfc-bd40-ba88f6e22cdf None None] Authenticating user token {{(pid=88550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:06:56.721309 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a78e90eb-e7c4-4312-bd8b-419012dde5e2 None None] REQUEST_METHOD: `GET` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:06:56.721599 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a78e90eb-e7c4-4312-bd8b-419012dde5e2 None None] SCRIPT_NAME: `/identity` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:06:56.721871 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a78e90eb-e7c4-4312-bd8b-419012dde5e2 None None] PATH_INFO: `/` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:06:56.723590 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: [pid: 88551|app: 0|req: 366/746] 10.222.0.26 () {54 vars in 927 bytes} [Wed Aug 17 19:06:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 19:06:56.729216 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dfd4c29-374f-4d50-a331-3e92aa0c0d6a None None] REQUEST_METHOD: `POST` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:06:56.729502 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dfd4c29-374f-4d50-a331-3e92aa0c0d6a None None] SCRIPT_NAME: `/identity` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:06:56.729774 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dfd4c29-374f-4d50-a331-3e92aa0c0d6a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:06:56.748346 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.auth.core [None req-3dfd4c29-374f-4d50-a331-3e92aa0c0d6a None None] MFA Rules not processed for user `819d41a279e64291acc60de51e1530ae`. Rule list: `[]` (Enabled: `True`). {{(pid=88551) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 19:06:56.749530 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.common.fernet_utils [None req-3dfd4c29-374f-4d50-a331-3e92aa0c0d6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:06:56.785302 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-974a06d8-7860-4dfc-bd40-ba88f6e22cdf None None] Validating token access rules against request {{(pid=88550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:06:56.819648 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60978fd8-a288-4a36-bbbd-1957b1ef58a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '819d41a279e64291acc60de51e1530ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:06:56.820256 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60978fd8-a288-4a36-bbbd-1957b1ef58a1 None admin] REQUEST_METHOD: `GET` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:06:56.820535 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60978fd8-a288-4a36-bbbd-1957b1ef58a1 None admin] SCRIPT_NAME: `/identity` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:06:56.820833 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60978fd8-a288-4a36-bbbd-1957b1ef58a1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:06:56.824909 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: [pid: 88551|app: 0|req: 367/747] 10.222.0.26 () {58 vars in 1024 bytes} [Wed Aug 17 19:06:56 2022] POST /identity/v3/auth/tokens => generated 1406 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 17 19:06:56.885258 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG dbcounter [-] [88550] Writing DB stats keystone:SELECT=100 {{(pid=88550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:06:56.889831 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60978fd8-a288-4a36-bbbd-1957b1ef58a1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:06:56.891343 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60978fd8-a288-4a36-bbbd-1957b1ef58a1 None admin] RBAC: Authorization granted {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:06:57.003904 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: [pid: 88550|app: 0|req: 381/748] 10.222.0.26 () {58 vars in 1282 bytes} [Wed Aug 17 19:06:56 2022] GET /identity/v3/auth/tokens => generated 1406 bytes in 339 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 17 19:06:57.009728 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dfd4c29-374f-4d50-a331-3e92aa0c0d6a None None] Authenticating user token {{(pid=88551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:06:57.096773 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG dbcounter [-] [88551] Writing DB stats keystone:SELECT=100 {{(pid=88551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:06:57.117449 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0197ad48-3334-4980-9ced-1462233721d6 None None] REQUEST_METHOD: `GET` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:06:57.117739 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0197ad48-3334-4980-9ced-1462233721d6 None None] SCRIPT_NAME: `/identity` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:06:57.118015 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0197ad48-3334-4980-9ced-1462233721d6 None None] PATH_INFO: `/` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:06:57.119369 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: [pid: 88550|app: 0|req: 382/749] 10.222.0.26 () {54 vars in 927 bytes} [Wed Aug 17 19:06:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 17 19:06:57.123873 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dfd4c29-374f-4d50-a331-3e92aa0c0d6a None None] Validating token access rules against request {{(pid=88551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:06:57.125124 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ef8e69-8a18-447e-bb9a-64bcb992564c None None] REQUEST_METHOD: `POST` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:06:57.125408 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ef8e69-8a18-447e-bb9a-64bcb992564c None None] SCRIPT_NAME: `/identity` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:06:57.125680 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ef8e69-8a18-447e-bb9a-64bcb992564c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:06:57.143398 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.auth.core [None req-14ef8e69-8a18-447e-bb9a-64bcb992564c None None] MFA Rules not processed for user `819d41a279e64291acc60de51e1530ae`. Rule list: `[]` (Enabled: `True`). {{(pid=88550) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 19:06:57.144597 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.common.fernet_utils [None req-14ef8e69-8a18-447e-bb9a-64bcb992564c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:06:57.163996 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5635663e-8834-46bb-9ce7-b5c12efa8876 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '819d41a279e64291acc60de51e1530ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:06:57.164642 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5635663e-8834-46bb-9ce7-b5c12efa8876 None admin] REQUEST_METHOD: `GET` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:06:57.164919 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5635663e-8834-46bb-9ce7-b5c12efa8876 None admin] SCRIPT_NAME: `/identity` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:06:57.165187 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5635663e-8834-46bb-9ce7-b5c12efa8876 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:06:57.175789 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5635663e-8834-46bb-9ce7-b5c12efa8876 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:06:57.177213 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5635663e-8834-46bb-9ce7-b5c12efa8876 None admin] RBAC: Authorization granted {{(pid=88551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:06:57.192580 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application [None req-5635663e-8834-46bb-9ce7-b5c12efa8876 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 19:06:57.192580 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 19:06:57.192580 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 19:06:57.192580 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 19:06:57.192580 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 19:06:57.192580 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 19:06:57.192580 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 19:06:57.192580 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 19:06:57.192580 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 19:06:57.192580 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 19:06:57.192580 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 19:06:57.192580 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 19:06:57.192580 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 17 19:06:57.192580 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 17 19:06:57.192580 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 17 19:06:57.192580 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 17 19:06:57.193755 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 19:06:57.193755 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 19:06:57.193755 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 19:06:57.193755 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 19:06:57.193755 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 19:06:57.193755 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 19:06:57.193755 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 19:06:57.193755 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application with Lock( Aug 17 19:06:57.193755 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 19:06:57.193755 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application return self._enter() Aug 17 19:06:57.193755 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 19:06:57.193755 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 19:06:57.193755 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 19:06:57.193755 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application return self.creator() Aug 17 19:06:57.193755 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 19:06:57.193755 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application created_value = creator( Aug 17 19:06:57.193755 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 17 19:06:57.194763 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 17 19:06:57.194763 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 19:06:57.194763 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application Aug 17 19:06:57.194763 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: [pid: 88551|app: 0|req: 368/750] 10.222.0.26 () {56 vars in 1108 bytes} [Wed Aug 17 19:06:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 19:06:57.194763 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5635663e-8834-46bb-9ce7-b5c12efa8876 None admin] Authenticating user token {{(pid=88551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:06:57.216265 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: [pid: 88550|app: 0|req: 383/751] 10.222.0.26 () {58 vars in 1024 bytes} [Wed Aug 17 19:06:57 2022] POST /identity/v3/auth/tokens => generated 1406 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 17 19:06:57.216265 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14ef8e69-8a18-447e-bb9a-64bcb992564c None None] Authenticating user token {{(pid=88550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:06:57.244779 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG dbcounter [-] [88550] Writing DB stats keystone:SELECT=100 {{(pid=88550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:06:57.310682 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5635663e-8834-46bb-9ce7-b5c12efa8876 None admin] Validating token access rules against request {{(pid=88551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:06:57.322891 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14ef8e69-8a18-447e-bb9a-64bcb992564c None None] Validating token access rules against request {{(pid=88550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:06:57.338355 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG dbcounter [-] [88551] Writing DB stats keystone:SELECT=100 {{(pid=88551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:06:57.346484 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c72abebc-6c90-4577-9e6f-221e4bf1944a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '819d41a279e64291acc60de51e1530ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:06:57.350558 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c72abebc-6c90-4577-9e6f-221e4bf1944a None admin] REQUEST_METHOD: `GET` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:06:57.350558 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c72abebc-6c90-4577-9e6f-221e4bf1944a None admin] SCRIPT_NAME: `/identity` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:06:57.350558 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c72abebc-6c90-4577-9e6f-221e4bf1944a None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:06:57.350558 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c72abebc-6c90-4577-9e6f-221e4bf1944a None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=88551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:06:57.350558 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c72abebc-6c90-4577-9e6f-221e4bf1944a None admin] RBAC: Authorization granted {{(pid=88551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:06:57.359274 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application [None req-c72abebc-6c90-4577-9e6f-221e4bf1944a None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 17 19:06:57.359274 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 19:06:57.359274 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 17 19:06:57.359274 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 17 19:06:57.359274 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 17 19:06:57.359274 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 17 19:06:57.359274 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 17 19:06:57.359274 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 17 19:06:57.359274 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 17 19:06:57.359274 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application Aug 17 19:06:57.359274 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 17 19:06:57.359274 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application Aug 17 19:06:57.359274 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 19:06:57.359274 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 19:06:57.359274 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 19:06:57.359274 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 19:06:57.360244 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 19:06:57.360244 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 19:06:57.360244 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 19:06:57.360244 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 19:06:57.360244 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 19:06:57.360244 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 19:06:57.360244 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 19:06:57.360244 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 17 19:06:57.360244 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 17 19:06:57.360244 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 17 19:06:57.360244 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 17 19:06:57.360244 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 19:06:57.360244 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 19:06:57.360244 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 19:06:57.360244 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 19:06:57.360244 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 19:06:57.360244 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 19:06:57.363612 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 19:06:57.363612 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application with Lock( Aug 17 19:06:57.363612 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 19:06:57.363612 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application return self._enter() Aug 17 19:06:57.363612 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 19:06:57.363612 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 19:06:57.363612 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 19:06:57.363612 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application return self.creator() Aug 17 19:06:57.363612 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 19:06:57.363612 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application created_value = creator( Aug 17 19:06:57.363612 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 17 19:06:57.363612 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 17 19:06:57.363612 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 17 19:06:57.363612 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application Aug 17 19:06:57.364461 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b13beb34-3fbe-4ea2-97b0-e9151fbdc37b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '819d41a279e64291acc60de51e1530ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:06:57.364461 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b13beb34-3fbe-4ea2-97b0-e9151fbdc37b None admin] REQUEST_METHOD: `GET` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:06:57.364461 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b13beb34-3fbe-4ea2-97b0-e9151fbdc37b None admin] SCRIPT_NAME: `/identity` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:06:57.364461 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b13beb34-3fbe-4ea2-97b0-e9151fbdc37b None admin] PATH_INFO: `/v3/domains` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:06:57.364741 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: [pid: 88551|app: 0|req: 369/752] 10.222.0.26 () {56 vars in 1132 bytes} [Wed Aug 17 19:06:57 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 19:06:57.364811 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b13beb34-3fbe-4ea2-97b0-e9151fbdc37b None admin] RBAC: Adding query filter params (name=Default) {{(pid=88550) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 19:06:57.364811 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b13beb34-3fbe-4ea2-97b0-e9151fbdc37b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:06:57.364811 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b13beb34-3fbe-4ea2-97b0-e9151fbdc37b None admin] RBAC: Authorization granted {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:06:57.366695 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c72abebc-6c90-4577-9e6f-221e4bf1944a None admin] Authenticating user token {{(pid=88551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:06:57.376342 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: [pid: 88550|app: 0|req: 384/753] 10.222.0.26 () {56 vars in 1109 bytes} [Wed Aug 17 19:06:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 19:06:57.524184 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c72abebc-6c90-4577-9e6f-221e4bf1944a None admin] Validating token access rules against request {{(pid=88551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:06:57.557468 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b13beb34-3fbe-4ea2-97b0-e9151fbdc37b None admin] Authenticating user token {{(pid=88550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:06:57.577413 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8719b8f-d543-4127-9cef-746d09937ab6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '819d41a279e64291acc60de51e1530ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:06:57.578026 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8719b8f-d543-4127-9cef-746d09937ab6 None admin] REQUEST_METHOD: `GET` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:06:57.578306 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8719b8f-d543-4127-9cef-746d09937ab6 None admin] SCRIPT_NAME: `/identity` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:06:57.578612 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8719b8f-d543-4127-9cef-746d09937ab6 None admin] PATH_INFO: `/v3/services` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:06:57.579247 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8719b8f-d543-4127-9cef-746d09937ab6 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=88551) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 19:06:57.579552 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8719b8f-d543-4127-9cef-746d09937ab6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:06:57.580914 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8719b8f-d543-4127-9cef-746d09937ab6 None admin] RBAC: Authorization granted {{(pid=88551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:06:57.586291 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: [pid: 88551|app: 0|req: 370/754] 10.222.0.26 () {56 vars in 1126 bytes} [Wed Aug 17 19:06:57 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 19:06:57.592291 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8719b8f-d543-4127-9cef-746d09937ab6 None admin] Authenticating user token {{(pid=88551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:06:57.653405 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG dbcounter [-] [88551] Writing DB stats keystone:SELECT=100 {{(pid=88551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:06:57.668016 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG dbcounter [-] [88550] Writing DB stats keystone:SELECT=100 {{(pid=88550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:06:57.685871 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b13beb34-3fbe-4ea2-97b0-e9151fbdc37b None admin] Validating token access rules against request {{(pid=88550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:06:57.702460 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8719b8f-d543-4127-9cef-746d09937ab6 None admin] Validating token access rules against request {{(pid=88551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:06:57.725348 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94c27dc8-ece0-40cc-b0b8-a4b1f3b86086 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '819d41a279e64291acc60de51e1530ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:06:57.725977 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c27dc8-ece0-40cc-b0b8-a4b1f3b86086 None admin] REQUEST_METHOD: `GET` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:06:57.726259 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c27dc8-ece0-40cc-b0b8-a4b1f3b86086 None admin] SCRIPT_NAME: `/identity` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:06:57.726529 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c27dc8-ece0-40cc-b0b8-a4b1f3b86086 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:06:57.727165 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94c27dc8-ece0-40cc-b0b8-a4b1f3b86086 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:06:57.728533 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94c27dc8-ece0-40cc-b0b8-a4b1f3b86086 None admin] RBAC: Authorization granted {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:06:57.737634 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application [None req-94c27dc8-ece0-40cc-b0b8-a4b1f3b86086 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 17 19:06:57.737634 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 19:06:57.737634 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 17 19:06:57.737634 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 17 19:06:57.737634 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 17 19:06:57.737634 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 17 19:06:57.737634 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 17 19:06:57.737634 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 17 19:06:57.737634 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 17 19:06:57.737634 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application Aug 17 19:06:57.737634 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 17 19:06:57.737634 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application Aug 17 19:06:57.737634 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 19:06:57.737634 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 19:06:57.737634 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 19:06:57.737634 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 19:06:57.737634 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 19:06:57.738889 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 19:06:57.738889 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 19:06:57.738889 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 19:06:57.738889 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 19:06:57.738889 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 19:06:57.738889 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 19:06:57.738889 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 17 19:06:57.738889 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 17 19:06:57.738889 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 17 19:06:57.738889 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 17 19:06:57.738889 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 19:06:57.738889 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 19:06:57.738889 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 19:06:57.738889 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 19:06:57.738889 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 19:06:57.738889 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 19:06:57.739935 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 19:06:57.739935 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application with Lock( Aug 17 19:06:57.739935 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 19:06:57.739935 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return self._enter() Aug 17 19:06:57.739935 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 19:06:57.739935 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 19:06:57.739935 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 19:06:57.739935 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return self.creator() Aug 17 19:06:57.739935 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 19:06:57.739935 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application created_value = creator( Aug 17 19:06:57.739935 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 17 19:06:57.739935 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 17 19:06:57.739935 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 17 19:06:57.739935 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application Aug 17 19:06:57.739935 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: [pid: 88550|app: 0|req: 385/755] 10.222.0.26 () {56 vars in 1114 bytes} [Wed Aug 17 19:06:57 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 17 19:06:57.742803 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5217d52-d522-49e5-9fc7-7bae9e33b053 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '819d41a279e64291acc60de51e1530ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:06:57.743398 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5217d52-d522-49e5-9fc7-7bae9e33b053 None admin] REQUEST_METHOD: `GET` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:06:57.748058 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5217d52-d522-49e5-9fc7-7bae9e33b053 None admin] SCRIPT_NAME: `/identity` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:06:57.748058 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5217d52-d522-49e5-9fc7-7bae9e33b053 None admin] PATH_INFO: `/v3/services` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:06:57.748058 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5217d52-d522-49e5-9fc7-7bae9e33b053 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=88551) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 19:06:57.748058 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5217d52-d522-49e5-9fc7-7bae9e33b053 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:06:57.748352 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94c27dc8-ece0-40cc-b0b8-a4b1f3b86086 None admin] Authenticating user token {{(pid=88550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:06:57.748438 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5217d52-d522-49e5-9fc7-7bae9e33b053 None admin] RBAC: Authorization granted {{(pid=88551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:06:57.752573 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: [pid: 88551|app: 0|req: 371/756] 10.222.0.26 () {56 vars in 1126 bytes} [Wed Aug 17 19:06:57 2022] GET /identity/v3/services?type=compute_legacy => generated 131 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 19:06:57.852111 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94c27dc8-ece0-40cc-b0b8-a4b1f3b86086 None admin] Validating token access rules against request {{(pid=88550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:06:57.887895 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a2b9013-e332-4041-ba61-1e8d1c4d9927 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '819d41a279e64291acc60de51e1530ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:06:57.888511 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a2b9013-e332-4041-ba61-1e8d1c4d9927 None admin] REQUEST_METHOD: `GET` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:06:57.888788 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a2b9013-e332-4041-ba61-1e8d1c4d9927 None admin] SCRIPT_NAME: `/identity` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:06:57.889056 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a2b9013-e332-4041-ba61-1e8d1c4d9927 None admin] PATH_INFO: `/v3/services` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:06:57.889693 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a2b9013-e332-4041-ba61-1e8d1c4d9927 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=88550) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 19:06:57.889992 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a2b9013-e332-4041-ba61-1e8d1c4d9927 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:06:57.891411 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a2b9013-e332-4041-ba61-1e8d1c4d9927 None admin] RBAC: Authorization granted {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:06:57.896506 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: [pid: 88550|app: 0|req: 386/757] 10.222.0.26 () {56 vars in 1114 bytes} [Wed Aug 17 19:06:57 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 17 19:06:57.902438 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5217d52-d522-49e5-9fc7-7bae9e33b053 None admin] Authenticating user token {{(pid=88551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:06:58.009482 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5217d52-d522-49e5-9fc7-7bae9e33b053 None admin] Validating token access rules against request {{(pid=88551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:06:58.027262 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG dbcounter [-] [88551] Writing DB stats keystone:SELECT=100 {{(pid=88551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:06:58.045645 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9716e301-2ac6-49b1-b456-46f100e90b3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '819d41a279e64291acc60de51e1530ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:06:58.046239 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9716e301-2ac6-49b1-b456-46f100e90b3d None admin] REQUEST_METHOD: `GET` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:06:58.046521 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9716e301-2ac6-49b1-b456-46f100e90b3d None admin] SCRIPT_NAME: `/identity` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:06:58.046826 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9716e301-2ac6-49b1-b456-46f100e90b3d None admin] PATH_INFO: `/v3/services` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:06:58.047451 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9716e301-2ac6-49b1-b456-46f100e90b3d None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=88551) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 19:06:58.047752 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9716e301-2ac6-49b1-b456-46f100e90b3d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:06:58.049184 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9716e301-2ac6-49b1-b456-46f100e90b3d None admin] RBAC: Authorization granted {{(pid=88551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:06:58.053514 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: [pid: 88551|app: 0|req: 372/758] 10.222.0.26 () {56 vars in 1114 bytes} [Wed Aug 17 19:06:57 2022] GET /identity/v3/services?type=volumev3 => generated 125 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 17 19:06:59.970929 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a6b6ebf-669a-44ba-ab78-bab349ede242 None None] REQUEST_METHOD: `GET` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:06:59.971548 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a6b6ebf-669a-44ba-ab78-bab349ede242 None None] SCRIPT_NAME: `/identity` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:06:59.971548 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a6b6ebf-669a-44ba-ab78-bab349ede242 None None] PATH_INFO: `/` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:06:59.972782 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: [pid: 88550|app: 0|req: 387/759] 10.222.0.26 () {54 vars in 927 bytes} [Wed Aug 17 19:06:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 19:06:59.978159 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72825ca9-eb43-4e50-ad01-587ab4080120 None None] REQUEST_METHOD: `POST` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:06:59.978622 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72825ca9-eb43-4e50-ad01-587ab4080120 None None] SCRIPT_NAME: `/identity` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:06:59.978745 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72825ca9-eb43-4e50-ad01-587ab4080120 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:06:59.996513 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.auth.core [None req-72825ca9-eb43-4e50-ad01-587ab4080120 None None] MFA Rules not processed for user `819d41a279e64291acc60de51e1530ae`. Rule list: `[]` (Enabled: `True`). {{(pid=88551) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 19:06:59.997695 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.common.fernet_utils [None req-72825ca9-eb43-4e50-ad01-587ab4080120 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:07:00.066428 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: [pid: 88551|app: 0|req: 373/760] 10.222.0.26 () {58 vars in 1024 bytes} [Wed Aug 17 19:06:59 2022] POST /identity/v3/auth/tokens => generated 1406 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 17 19:07:00.273525 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ae5981-3e94-41ce-a1ef-011cf0c7133c None None] REQUEST_METHOD: `GET` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:07:00.273823 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ae5981-3e94-41ce-a1ef-011cf0c7133c None None] SCRIPT_NAME: `/identity` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:07:00.274086 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ae5981-3e94-41ce-a1ef-011cf0c7133c None None] PATH_INFO: `/` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:07:00.275469 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: [pid: 88550|app: 0|req: 388/761] 10.222.0.26 () {54 vars in 927 bytes} [Wed Aug 17 19:07:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 19:07:00.280951 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69febd1e-f358-4cc3-a47e-6eaf0bf11f7c None None] REQUEST_METHOD: `POST` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:07:00.281234 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69febd1e-f358-4cc3-a47e-6eaf0bf11f7c None None] SCRIPT_NAME: `/identity` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:07:00.281504 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69febd1e-f358-4cc3-a47e-6eaf0bf11f7c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:07:00.300090 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.auth.core [None req-69febd1e-f358-4cc3-a47e-6eaf0bf11f7c None None] MFA Rules not processed for user `819d41a279e64291acc60de51e1530ae`. Rule list: `[]` (Enabled: `True`). {{(pid=88551) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 19:07:00.301287 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.common.fernet_utils [None req-69febd1e-f358-4cc3-a47e-6eaf0bf11f7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:07:00.370924 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: [pid: 88551|app: 0|req: 374/762] 10.222.0.26 () {58 vars in 1024 bytes} [Wed Aug 17 19:07:00 2022] POST /identity/v3/auth/tokens => generated 1406 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 17 19:07:00.395486 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26ae5981-3e94-41ce-a1ef-011cf0c7133c None None] Authenticating user token {{(pid=88550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:07:00.413312 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG dbcounter [-] [88550] Writing DB stats keystone:SELECT=100 {{(pid=88550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:07:00.493204 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26ae5981-3e94-41ce-a1ef-011cf0c7133c None None] Validating token access rules against request {{(pid=88550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:07:00.530189 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ab0ede2-a2b6-4f77-b9cb-e463e752446d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '819d41a279e64291acc60de51e1530ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:07:00.530189 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab0ede2-a2b6-4f77-b9cb-e463e752446d None admin] REQUEST_METHOD: `POST` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:07:00.530189 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab0ede2-a2b6-4f77-b9cb-e463e752446d None admin] SCRIPT_NAME: `/identity` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:07:00.530189 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab0ede2-a2b6-4f77-b9cb-e463e752446d None admin] PATH_INFO: `/v3/services` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:07:00.530739 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ab0ede2-a2b6-4f77-b9cb-e463e752446d None admin] RBAC: Authorizing `identity:create_service()` {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:07:00.530739 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ab0ede2-a2b6-4f77-b9cb-e463e752446d None admin] RBAC: Authorization granted {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:07:00.640432 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: [pid: 88550|app: 0|req: 389/763] 10.222.0.26 () {60 vars in 1141 bytes} [Wed Aug 17 19:07:00 2022] POST /identity/v3/services => generated 269 bytes in 245 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 19:07:00.707112 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69febd1e-f358-4cc3-a47e-6eaf0bf11f7c None None] Authenticating user token {{(pid=88551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:07:00.753763 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG dbcounter [-] [88551] Writing DB stats keystone:SELECT=100 {{(pid=88551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:07:00.813723 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69febd1e-f358-4cc3-a47e-6eaf0bf11f7c None None] Validating token access rules against request {{(pid=88551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:07:00.854144 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32ddc9a9-bda0-4c90-86f4-262597ba9d0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '819d41a279e64291acc60de51e1530ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:07:00.854777 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ddc9a9-bda0-4c90-86f4-262597ba9d0b None admin] REQUEST_METHOD: `POST` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:07:00.855057 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ddc9a9-bda0-4c90-86f4-262597ba9d0b None admin] SCRIPT_NAME: `/identity` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:07:00.855327 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ddc9a9-bda0-4c90-86f4-262597ba9d0b None admin] PATH_INFO: `/v3/services` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:07:00.855978 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32ddc9a9-bda0-4c90-86f4-262597ba9d0b None admin] RBAC: Authorizing `identity:create_service()` {{(pid=88551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:07:00.857872 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32ddc9a9-bda0-4c90-86f4-262597ba9d0b None admin] RBAC: Authorization granted {{(pid=88551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:07:00.967026 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: [pid: 88551|app: 0|req: 375/764] 10.222.0.26 () {60 vars in 1141 bytes} [Wed Aug 17 19:07:00 2022] POST /identity/v3/services => generated 251 bytes in 261 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 19:07:02.871818 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e81ff5-5b0e-4d98-915f-541acbab290e None None] REQUEST_METHOD: `GET` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:07:02.871818 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e81ff5-5b0e-4d98-915f-541acbab290e None None] SCRIPT_NAME: `/identity` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:07:02.871818 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e81ff5-5b0e-4d98-915f-541acbab290e None None] PATH_INFO: `/` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:07:02.871818 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: [pid: 88550|app: 0|req: 390/765] 10.222.0.26 () {54 vars in 927 bytes} [Wed Aug 17 19:07:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 19:07:02.877857 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2adf4596-6989-40cc-a551-8d26f18764ee None None] REQUEST_METHOD: `POST` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:07:02.878388 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2adf4596-6989-40cc-a551-8d26f18764ee None None] SCRIPT_NAME: `/identity` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:07:02.878388 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2adf4596-6989-40cc-a551-8d26f18764ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:07:02.897079 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.auth.core [None req-2adf4596-6989-40cc-a551-8d26f18764ee None None] MFA Rules not processed for user `819d41a279e64291acc60de51e1530ae`. Rule list: `[]` (Enabled: `True`). {{(pid=88551) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 19:07:02.901051 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.common.fernet_utils [None req-2adf4596-6989-40cc-a551-8d26f18764ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:07:02.976066 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: [pid: 88551|app: 0|req: 376/766] 10.222.0.26 () {58 vars in 1024 bytes} [Wed Aug 17 19:07:02 2022] POST /identity/v3/auth/tokens => generated 1617 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 17 19:07:03.176593 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d58b7d-1cd4-461d-af2e-d70898dd4010 None None] REQUEST_METHOD: `GET` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:07:03.176812 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d58b7d-1cd4-461d-af2e-d70898dd4010 None None] SCRIPT_NAME: `/identity` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:07:03.177062 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d58b7d-1cd4-461d-af2e-d70898dd4010 None None] PATH_INFO: `/` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:07:03.178392 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: [pid: 88550|app: 0|req: 391/767] 10.222.0.26 () {54 vars in 927 bytes} [Wed Aug 17 19:07:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 19:07:03.183734 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ede2525-5c3e-476d-88b7-61d5b84ea294 None None] REQUEST_METHOD: `POST` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:07:03.184020 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ede2525-5c3e-476d-88b7-61d5b84ea294 None None] SCRIPT_NAME: `/identity` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:07:03.184292 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ede2525-5c3e-476d-88b7-61d5b84ea294 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:07:03.202858 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.auth.core [None req-2ede2525-5c3e-476d-88b7-61d5b84ea294 None None] MFA Rules not processed for user `819d41a279e64291acc60de51e1530ae`. Rule list: `[]` (Enabled: `True`). {{(pid=88551) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 19:07:03.204037 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.common.fernet_utils [None req-2ede2525-5c3e-476d-88b7-61d5b84ea294 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:07:03.221392 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG dbcounter [-] [88551] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:07:03.271836 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: [pid: 88551|app: 0|req: 377/768] 10.222.0.26 () {58 vars in 1024 bytes} [Wed Aug 17 19:07:03 2022] POST /identity/v3/auth/tokens => generated 1617 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 17 19:07:03.305357 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6d58b7d-1cd4-461d-af2e-d70898dd4010 None None] Authenticating user token {{(pid=88550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:07:03.383888 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG dbcounter [-] [88550] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:07:03.406876 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6d58b7d-1cd4-461d-af2e-d70898dd4010 None None] Validating token access rules against request {{(pid=88550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:07:03.442591 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b9cda37-73ca-417d-96fd-2686933bd4f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '819d41a279e64291acc60de51e1530ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:07:03.442591 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b9cda37-73ca-417d-96fd-2686933bd4f5 None admin] REQUEST_METHOD: `GET` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:07:03.442591 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b9cda37-73ca-417d-96fd-2686933bd4f5 None admin] SCRIPT_NAME: `/identity` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:07:03.442591 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b9cda37-73ca-417d-96fd-2686933bd4f5 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:07:03.443002 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b9cda37-73ca-417d-96fd-2686933bd4f5 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:07:03.444030 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b9cda37-73ca-417d-96fd-2686933bd4f5 None admin] RBAC: Authorization granted {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:07:03.452729 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application [None req-7b9cda37-73ca-417d-96fd-2686933bd4f5 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 17 19:07:03.452729 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 19:07:03.452729 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 17 19:07:03.452729 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 17 19:07:03.452729 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 17 19:07:03.452729 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 17 19:07:03.452729 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 17 19:07:03.452729 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 17 19:07:03.452729 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 17 19:07:03.452729 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application Aug 17 19:07:03.452729 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 17 19:07:03.452729 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application Aug 17 19:07:03.452729 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 19:07:03.452729 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 19:07:03.452729 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 19:07:03.452729 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 19:07:03.453876 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 19:07:03.453876 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 19:07:03.453876 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 19:07:03.453876 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 19:07:03.453876 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 19:07:03.453876 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 19:07:03.453876 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 19:07:03.453876 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 17 19:07:03.453876 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 17 19:07:03.453876 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 17 19:07:03.453876 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 17 19:07:03.453876 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 19:07:03.453876 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 19:07:03.453876 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 19:07:03.453876 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 19:07:03.453876 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 19:07:03.453876 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 19:07:03.454922 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 19:07:03.454922 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application with Lock( Aug 17 19:07:03.454922 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 19:07:03.454922 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return self._enter() Aug 17 19:07:03.454922 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 19:07:03.454922 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 19:07:03.454922 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 19:07:03.454922 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return self.creator() Aug 17 19:07:03.454922 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 19:07:03.454922 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application created_value = creator( Aug 17 19:07:03.454922 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 17 19:07:03.454922 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 17 19:07:03.454922 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 17 19:07:03.454922 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application Aug 17 19:07:03.454922 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: [pid: 88550|app: 0|req: 392/769] 10.222.0.26 () {56 vars in 1132 bytes} [Wed Aug 17 19:07:03 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 149 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 19:07:03.459939 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ede2525-5c3e-476d-88b7-61d5b84ea294 None None] Authenticating user token {{(pid=88551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:07:03.559724 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ede2525-5c3e-476d-88b7-61d5b84ea294 None None] Validating token access rules against request {{(pid=88551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:07:03.593012 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e910aca-b70c-433d-9136-d5bb29a74592 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '819d41a279e64291acc60de51e1530ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:07:03.593605 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e910aca-b70c-433d-9136-d5bb29a74592 None admin] REQUEST_METHOD: `GET` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:07:03.593911 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e910aca-b70c-433d-9136-d5bb29a74592 None admin] SCRIPT_NAME: `/identity` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:07:03.594179 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e910aca-b70c-433d-9136-d5bb29a74592 None admin] PATH_INFO: `/v3/services` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:07:03.594842 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e910aca-b70c-433d-9136-d5bb29a74592 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=88551) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 19:07:03.595142 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e910aca-b70c-433d-9136-d5bb29a74592 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:07:03.596487 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e910aca-b70c-433d-9136-d5bb29a74592 None admin] RBAC: Authorization granted {{(pid=88551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:07:03.598555 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b9cda37-73ca-417d-96fd-2686933bd4f5 None admin] Authenticating user token {{(pid=88550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:07:03.602582 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: [pid: 88551|app: 0|req: 378/770] 10.222.0.26 () {56 vars in 1126 bytes} [Wed Aug 17 19:07:03 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 19:07:03.607636 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e910aca-b70c-433d-9136-d5bb29a74592 None admin] Authenticating user token {{(pid=88551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:07:03.626858 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG dbcounter [-] [88551] Writing DB stats keystone:SELECT=100 {{(pid=88551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:07:03.699210 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b9cda37-73ca-417d-96fd-2686933bd4f5 None admin] Validating token access rules against request {{(pid=88550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:07:03.707960 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e910aca-b70c-433d-9136-d5bb29a74592 None admin] Validating token access rules against request {{(pid=88551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:07:03.732886 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d7640e0-b41d-4155-8eb7-8571abcf5746 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '819d41a279e64291acc60de51e1530ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:07:03.733506 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d7640e0-b41d-4155-8eb7-8571abcf5746 None admin] REQUEST_METHOD: `GET` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:07:03.733787 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d7640e0-b41d-4155-8eb7-8571abcf5746 None admin] SCRIPT_NAME: `/identity` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:07:03.734064 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d7640e0-b41d-4155-8eb7-8571abcf5746 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:07:03.734683 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d7640e0-b41d-4155-8eb7-8571abcf5746 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:07:03.736041 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d7640e0-b41d-4155-8eb7-8571abcf5746 None admin] RBAC: Authorization granted {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:07:03.740881 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72c4a4ea-06eb-47d4-b0b3-e600cdbf7fe0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '819d41a279e64291acc60de51e1530ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:07:03.741466 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c4a4ea-06eb-47d4-b0b3-e600cdbf7fe0 None admin] REQUEST_METHOD: `GET` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:07:03.741740 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c4a4ea-06eb-47d4-b0b3-e600cdbf7fe0 None admin] SCRIPT_NAME: `/identity` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:07:03.742008 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c4a4ea-06eb-47d4-b0b3-e600cdbf7fe0 None admin] PATH_INFO: `/v3/services` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:07:03.742661 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72c4a4ea-06eb-47d4-b0b3-e600cdbf7fe0 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=88551) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 19:07:03.742961 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72c4a4ea-06eb-47d4-b0b3-e600cdbf7fe0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:07:03.744295 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72c4a4ea-06eb-47d4-b0b3-e600cdbf7fe0 None admin] RBAC: Authorization granted {{(pid=88551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:07:03.744574 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application [None req-4d7640e0-b41d-4155-8eb7-8571abcf5746 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 17 19:07:03.744574 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 19:07:03.744574 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 17 19:07:03.744574 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 17 19:07:03.744574 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 17 19:07:03.744574 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 17 19:07:03.744574 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 17 19:07:03.744574 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 17 19:07:03.744574 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 17 19:07:03.744574 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application Aug 17 19:07:03.744574 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 17 19:07:03.744574 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application Aug 17 19:07:03.744574 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 19:07:03.744574 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 19:07:03.744574 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 19:07:03.744574 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 19:07:03.744574 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 19:07:03.745987 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 19:07:03.745987 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 19:07:03.745987 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 19:07:03.745987 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 19:07:03.745987 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 19:07:03.745987 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 19:07:03.745987 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 17 19:07:03.745987 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 17 19:07:03.745987 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 17 19:07:03.745987 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 17 19:07:03.745987 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 19:07:03.745987 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 19:07:03.745987 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 19:07:03.745987 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 19:07:03.745987 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 19:07:03.745987 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 19:07:03.747944 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 19:07:03.747944 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application with Lock( Aug 17 19:07:03.747944 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 19:07:03.747944 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return self._enter() Aug 17 19:07:03.747944 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 19:07:03.747944 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 19:07:03.747944 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 19:07:03.747944 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return self.creator() Aug 17 19:07:03.747944 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 19:07:03.747944 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application created_value = creator( Aug 17 19:07:03.747944 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 17 19:07:03.747944 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 17 19:07:03.747944 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 17 19:07:03.747944 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application Aug 17 19:07:03.747944 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: [pid: 88550|app: 0|req: 393/771] 10.222.0.26 () {56 vars in 1114 bytes} [Wed Aug 17 19:07:03 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 148 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 19:07:03.755554 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: [pid: 88551|app: 0|req: 379/772] 10.222.0.26 () {56 vars in 1126 bytes} [Wed Aug 17 19:07:03 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 17 19:07:03.755790 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d7640e0-b41d-4155-8eb7-8571abcf5746 None admin] Authenticating user token {{(pid=88550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:07:03.755790 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG dbcounter [-] [88550] Writing DB stats keystone:SELECT=100 {{(pid=88550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:07:03.756460 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72c4a4ea-06eb-47d4-b0b3-e600cdbf7fe0 None admin] Authenticating user token {{(pid=88551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:07:03.838105 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG dbcounter [-] [88551] Writing DB stats keystone:SELECT=100 {{(pid=88551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:07:03.853352 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d7640e0-b41d-4155-8eb7-8571abcf5746 None admin] Validating token access rules against request {{(pid=88550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:07:03.857455 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72c4a4ea-06eb-47d4-b0b3-e600cdbf7fe0 None admin] Validating token access rules against request {{(pid=88551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:07:03.888290 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dd2f514-5849-49de-aabf-f9206c20320b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '819d41a279e64291acc60de51e1530ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:07:03.888887 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd2f514-5849-49de-aabf-f9206c20320b None admin] REQUEST_METHOD: `GET` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:07:03.889167 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd2f514-5849-49de-aabf-f9206c20320b None admin] SCRIPT_NAME: `/identity` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:07:03.889439 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd2f514-5849-49de-aabf-f9206c20320b None admin] PATH_INFO: `/v3/services` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:07:03.890119 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dd2f514-5849-49de-aabf-f9206c20320b None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=88550) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 19:07:03.890426 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dd2f514-5849-49de-aabf-f9206c20320b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:07:03.891874 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dd2f514-5849-49de-aabf-f9206c20320b None admin] RBAC: Authorization granted {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:07:03.892473 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea1d48c5-73c6-4a38-83e9-bd2e680176f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '819d41a279e64291acc60de51e1530ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:07:03.893073 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea1d48c5-73c6-4a38-83e9-bd2e680176f1 None admin] REQUEST_METHOD: `GET` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:07:03.893353 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea1d48c5-73c6-4a38-83e9-bd2e680176f1 None admin] SCRIPT_NAME: `/identity` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:07:03.893634 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea1d48c5-73c6-4a38-83e9-bd2e680176f1 None admin] PATH_INFO: `/v3/endpoints` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:07:03.894328 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea1d48c5-73c6-4a38-83e9-bd2e680176f1 None admin] RBAC: Adding query filter params (interface=public, service_id=6c337a664ee44913b59fb6c1534b108c, region_id=RegionOne) {{(pid=88551) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 19:07:03.894667 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea1d48c5-73c6-4a38-83e9-bd2e680176f1 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=88551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:07:03.896178 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea1d48c5-73c6-4a38-83e9-bd2e680176f1 None admin] RBAC: Authorization granted {{(pid=88551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:07:03.896801 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: [pid: 88550|app: 0|req: 394/773] 10.222.0.26 () {56 vars in 1114 bytes} [Wed Aug 17 19:07:03 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 19:07:03.902395 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dd2f514-5849-49de-aabf-f9206c20320b None admin] Authenticating user token {{(pid=88550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:07:03.907454 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: [pid: 88551|app: 0|req: 380/774] 10.222.0.26 () {56 vars in 1251 bytes} [Wed Aug 17 19:07:03 2022] GET /identity/v3/endpoints?service_id=6c337a664ee44913b59fb6c1534b108c&interface=public®ion_id=RegionOne => generated 194 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 17 19:07:03.908401 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea1d48c5-73c6-4a38-83e9-bd2e680176f1 None admin] Authenticating user token {{(pid=88551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:07:03.969520 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG dbcounter [-] [88550] Writing DB stats keystone:SELECT=100 {{(pid=88550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:07:04.002628 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dd2f514-5849-49de-aabf-f9206c20320b None admin] Validating token access rules against request {{(pid=88550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:07:04.009319 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea1d48c5-73c6-4a38-83e9-bd2e680176f1 None admin] Validating token access rules against request {{(pid=88551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:07:04.035364 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc22aa17-4647-4df1-9a21-e4324d3929c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '819d41a279e64291acc60de51e1530ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:07:04.036026 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc22aa17-4647-4df1-9a21-e4324d3929c2 None admin] REQUEST_METHOD: `GET` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:07:04.036311 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc22aa17-4647-4df1-9a21-e4324d3929c2 None admin] SCRIPT_NAME: `/identity` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:07:04.036585 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc22aa17-4647-4df1-9a21-e4324d3929c2 None admin] PATH_INFO: `/v3/services` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:07:04.037236 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc22aa17-4647-4df1-9a21-e4324d3929c2 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=88550) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 19:07:04.037628 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc22aa17-4647-4df1-9a21-e4324d3929c2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:07:04.039146 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc22aa17-4647-4df1-9a21-e4324d3929c2 None admin] RBAC: Authorization granted {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:07:04.050144 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22e8a8a5-4b1c-4b7b-b4fd-d110cfc1116f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '819d41a279e64291acc60de51e1530ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:07:04.050144 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e8a8a5-4b1c-4b7b-b4fd-d110cfc1116f None admin] REQUEST_METHOD: `GET` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:07:04.050144 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e8a8a5-4b1c-4b7b-b4fd-d110cfc1116f None admin] SCRIPT_NAME: `/identity` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:07:04.050465 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: [pid: 88550|app: 0|req: 395/775] 10.222.0.26 () {56 vars in 1114 bytes} [Wed Aug 17 19:07:03 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 17 19:07:04.050585 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e8a8a5-4b1c-4b7b-b4fd-d110cfc1116f None admin] PATH_INFO: `/v3/services` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:07:04.050585 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22e8a8a5-4b1c-4b7b-b4fd-d110cfc1116f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:07:04.050585 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22e8a8a5-4b1c-4b7b-b4fd-d110cfc1116f None admin] RBAC: Authorization granted {{(pid=88551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:07:04.050822 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc22aa17-4647-4df1-9a21-e4324d3929c2 None admin] Authenticating user token {{(pid=88550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:07:04.066583 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: [pid: 88551|app: 0|req: 381/776] 10.222.0.26 () {56 vars in 1087 bytes} [Wed Aug 17 19:07:03 2022] GET /identity/v3/services => generated 1498 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 17 19:07:04.157361 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc22aa17-4647-4df1-9a21-e4324d3929c2 None admin] Validating token access rules against request {{(pid=88550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:07:04.192759 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG dbcounter [-] [88550] Writing DB stats keystone:SELECT=100 {{(pid=88550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:07:04.197900 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8756e71d-c5a9-4147-b876-bea22f3f1285 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '819d41a279e64291acc60de51e1530ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:07:04.198515 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8756e71d-c5a9-4147-b876-bea22f3f1285 None admin] REQUEST_METHOD: `GET` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:07:04.198818 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8756e71d-c5a9-4147-b876-bea22f3f1285 None admin] SCRIPT_NAME: `/identity` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:07:04.199091 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8756e71d-c5a9-4147-b876-bea22f3f1285 None admin] PATH_INFO: `/v3/endpoints` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:07:04.199802 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8756e71d-c5a9-4147-b876-bea22f3f1285 None admin] RBAC: Adding query filter params (interface=public, service_id=ea1cd9f0e42e4bd8994a47c50cdd016b, region_id=RegionOne) {{(pid=88550) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 19:07:04.200114 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8756e71d-c5a9-4147-b876-bea22f3f1285 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:07:04.201601 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8756e71d-c5a9-4147-b876-bea22f3f1285 None admin] RBAC: Authorization granted {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:07:04.207345 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: [pid: 88550|app: 0|req: 396/777] 10.222.0.26 () {56 vars in 1251 bytes} [Wed Aug 17 19:07:04 2022] GET /identity/v3/endpoints?service_id=ea1cd9f0e42e4bd8994a47c50cdd016b&interface=public®ion_id=RegionOne => generated 194 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 17 19:07:04.220139 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22e8a8a5-4b1c-4b7b-b4fd-d110cfc1116f None admin] Authenticating user token {{(pid=88551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:07:04.226416 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG dbcounter [-] [88551] Writing DB stats keystone:SELECT=100 {{(pid=88551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:07:04.314737 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22e8a8a5-4b1c-4b7b-b4fd-d110cfc1116f None admin] Validating token access rules against request {{(pid=88551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:07:04.351130 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4293421-eebb-478d-a171-539270e8ac7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '819d41a279e64291acc60de51e1530ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:07:04.351728 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4293421-eebb-478d-a171-539270e8ac7a None admin] REQUEST_METHOD: `GET` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:07:04.352002 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4293421-eebb-478d-a171-539270e8ac7a None admin] SCRIPT_NAME: `/identity` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:07:04.352270 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4293421-eebb-478d-a171-539270e8ac7a None admin] PATH_INFO: `/v3/services` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:07:04.352869 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4293421-eebb-478d-a171-539270e8ac7a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:07:04.354359 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4293421-eebb-478d-a171-539270e8ac7a None admin] RBAC: Authorization granted {{(pid=88551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:07:04.360566 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: [pid: 88551|app: 0|req: 382/778] 10.222.0.26 () {56 vars in 1087 bytes} [Wed Aug 17 19:07:04 2022] GET /identity/v3/services => generated 1498 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 17 19:07:06.256977 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca4c4b68-b20c-494a-a3fd-971664738c1e None None] REQUEST_METHOD: `GET` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:07:06.257536 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca4c4b68-b20c-494a-a3fd-971664738c1e None None] SCRIPT_NAME: `/identity` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:07:06.257536 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca4c4b68-b20c-494a-a3fd-971664738c1e None None] PATH_INFO: `/` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:07:06.258911 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: [pid: 88550|app: 0|req: 397/779] 10.222.0.26 () {54 vars in 927 bytes} [Wed Aug 17 19:07:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 19:07:06.264593 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f82ede-8dc1-41e6-bcbf-002bd8d464e3 None None] REQUEST_METHOD: `POST` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:07:06.265100 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f82ede-8dc1-41e6-bcbf-002bd8d464e3 None None] SCRIPT_NAME: `/identity` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:07:06.265208 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f82ede-8dc1-41e6-bcbf-002bd8d464e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:07:06.282806 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.auth.core [None req-c1f82ede-8dc1-41e6-bcbf-002bd8d464e3 None None] MFA Rules not processed for user `819d41a279e64291acc60de51e1530ae`. Rule list: `[]` (Enabled: `True`). {{(pid=88551) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 19:07:06.283983 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.common.fernet_utils [None req-c1f82ede-8dc1-41e6-bcbf-002bd8d464e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:07:06.354313 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: [pid: 88551|app: 0|req: 383/780] 10.222.0.26 () {58 vars in 1024 bytes} [Wed Aug 17 19:07:06 2022] POST /identity/v3/auth/tokens => generated 1617 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 17 19:07:06.522359 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc127478-3183-415b-9716-d5d172c8379a None None] REQUEST_METHOD: `GET` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:07:06.522587 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc127478-3183-415b-9716-d5d172c8379a None None] SCRIPT_NAME: `/identity` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:07:06.522859 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc127478-3183-415b-9716-d5d172c8379a None None] PATH_INFO: `/` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:07:06.524295 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: [pid: 88550|app: 0|req: 398/781] 10.222.0.26 () {54 vars in 927 bytes} [Wed Aug 17 19:07:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 19:07:06.529639 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edefca05-0ee7-494b-9fd0-8d89f0b2d8d5 None None] REQUEST_METHOD: `POST` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:07:06.529920 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edefca05-0ee7-494b-9fd0-8d89f0b2d8d5 None None] SCRIPT_NAME: `/identity` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:07:06.530188 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edefca05-0ee7-494b-9fd0-8d89f0b2d8d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:07:06.537579 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG dbcounter [-] [88551] Writing DB stats keystone:SELECT=100 {{(pid=88551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:07:06.548444 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.auth.core [None req-edefca05-0ee7-494b-9fd0-8d89f0b2d8d5 None None] MFA Rules not processed for user `819d41a279e64291acc60de51e1530ae`. Rule list: `[]` (Enabled: `True`). {{(pid=88551) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 19:07:06.551863 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.common.fernet_utils [None req-edefca05-0ee7-494b-9fd0-8d89f0b2d8d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:07:06.616167 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: [pid: 88551|app: 0|req: 384/782] 10.222.0.26 () {58 vars in 1024 bytes} [Wed Aug 17 19:07:06 2022] POST /identity/v3/auth/tokens => generated 1617 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 17 19:07:06.684164 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc127478-3183-415b-9716-d5d172c8379a None None] Authenticating user token {{(pid=88550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:07:06.784533 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc127478-3183-415b-9716-d5d172c8379a None None] Validating token access rules against request {{(pid=88550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:07:06.818000 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30d2a0c0-7682-4f2f-9828-00cd2abb4a17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '819d41a279e64291acc60de51e1530ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:07:06.818644 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d2a0c0-7682-4f2f-9828-00cd2abb4a17 None admin] REQUEST_METHOD: `GET` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:07:06.818925 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d2a0c0-7682-4f2f-9828-00cd2abb4a17 None admin] SCRIPT_NAME: `/identity` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:07:06.819196 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d2a0c0-7682-4f2f-9828-00cd2abb4a17 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:07:06.819767 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30d2a0c0-7682-4f2f-9828-00cd2abb4a17 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:07:06.821109 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30d2a0c0-7682-4f2f-9828-00cd2abb4a17 None admin] RBAC: Authorization granted {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:07:06.829845 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application [None req-30d2a0c0-7682-4f2f-9828-00cd2abb4a17 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 17 19:07:06.829845 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 19:07:06.829845 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 17 19:07:06.829845 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 17 19:07:06.829845 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 17 19:07:06.829845 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 17 19:07:06.829845 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 17 19:07:06.829845 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 17 19:07:06.829845 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 17 19:07:06.829845 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application Aug 17 19:07:06.829845 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 17 19:07:06.829845 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application Aug 17 19:07:06.829845 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 19:07:06.829845 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 19:07:06.829845 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 19:07:06.829845 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 19:07:06.833473 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 19:07:06.833473 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 19:07:06.833473 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 19:07:06.833473 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 19:07:06.833473 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 19:07:06.833473 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 19:07:06.833473 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 19:07:06.833473 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 17 19:07:06.833473 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 17 19:07:06.833473 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 17 19:07:06.833473 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 17 19:07:06.833473 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 19:07:06.833473 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 19:07:06.833473 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 19:07:06.833473 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 19:07:06.833473 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 19:07:06.833473 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 19:07:06.834399 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 19:07:06.834399 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application with Lock( Aug 17 19:07:06.834399 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 19:07:06.834399 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return self._enter() Aug 17 19:07:06.834399 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 19:07:06.834399 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 19:07:06.834399 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 19:07:06.834399 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return self.creator() Aug 17 19:07:06.834399 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 19:07:06.834399 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application created_value = creator( Aug 17 19:07:06.834399 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 17 19:07:06.834399 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 17 19:07:06.834399 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 17 19:07:06.834399 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application Aug 17 19:07:06.834399 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: [pid: 88550|app: 0|req: 399/783] 10.222.0.26 () {56 vars in 1132 bytes} [Wed Aug 17 19:07:06 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 147 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 19:07:06.836875 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edefca05-0ee7-494b-9fd0-8d89f0b2d8d5 None None] Authenticating user token {{(pid=88551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:07:06.933869 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edefca05-0ee7-494b-9fd0-8d89f0b2d8d5 None None] Validating token access rules against request {{(pid=88551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:07:06.941323 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30d2a0c0-7682-4f2f-9828-00cd2abb4a17 None admin] Authenticating user token {{(pid=88550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:07:06.969191 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-376b0970-9adf-4653-93fa-839bde5f4750 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '819d41a279e64291acc60de51e1530ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:07:06.969791 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-376b0970-9adf-4653-93fa-839bde5f4750 None admin] REQUEST_METHOD: `GET` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:07:06.970067 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-376b0970-9adf-4653-93fa-839bde5f4750 None admin] SCRIPT_NAME: `/identity` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:07:06.970336 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-376b0970-9adf-4653-93fa-839bde5f4750 None admin] PATH_INFO: `/v3/services` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:07:06.970986 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-376b0970-9adf-4653-93fa-839bde5f4750 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=88551) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 19:07:06.971285 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-376b0970-9adf-4653-93fa-839bde5f4750 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:07:06.972713 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-376b0970-9adf-4653-93fa-839bde5f4750 None admin] RBAC: Authorization granted {{(pid=88551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:07:06.973748 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG dbcounter [-] [88551] Writing DB stats keystone:SELECT=100 {{(pid=88551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:07:06.977517 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: [pid: 88551|app: 0|req: 385/784] 10.222.0.26 () {56 vars in 1126 bytes} [Wed Aug 17 19:07:06 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 19:07:06.983648 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-376b0970-9adf-4653-93fa-839bde5f4750 None admin] Authenticating user token {{(pid=88551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:07:07.003167 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG dbcounter [-] [88550] Writing DB stats keystone:SELECT=100 {{(pid=88550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:07:07.043499 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30d2a0c0-7682-4f2f-9828-00cd2abb4a17 None admin] Validating token access rules against request {{(pid=88550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:07:07.081918 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66b77e24-216d-445f-b6e4-da96f46a87b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '819d41a279e64291acc60de51e1530ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:07:07.082558 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b77e24-216d-445f-b6e4-da96f46a87b3 None admin] REQUEST_METHOD: `GET` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:07:07.082847 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b77e24-216d-445f-b6e4-da96f46a87b3 None admin] SCRIPT_NAME: `/identity` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:07:07.083124 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b77e24-216d-445f-b6e4-da96f46a87b3 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:07:07.083224 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-376b0970-9adf-4653-93fa-839bde5f4750 None admin] Validating token access rules against request {{(pid=88551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:07:07.083702 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66b77e24-216d-445f-b6e4-da96f46a87b3 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:07:07.085070 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66b77e24-216d-445f-b6e4-da96f46a87b3 None admin] RBAC: Authorization granted {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:07:07.094352 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application [None req-66b77e24-216d-445f-b6e4-da96f46a87b3 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 17 19:07:07.094352 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 19:07:07.094352 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 17 19:07:07.094352 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 17 19:07:07.094352 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 17 19:07:07.094352 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 17 19:07:07.094352 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 17 19:07:07.094352 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 17 19:07:07.094352 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 17 19:07:07.094352 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application Aug 17 19:07:07.094352 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 17 19:07:07.094352 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application Aug 17 19:07:07.094352 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 19:07:07.094352 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 19:07:07.094352 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 19:07:07.094352 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 19:07:07.094352 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 19:07:07.095684 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 19:07:07.095684 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 19:07:07.095684 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 19:07:07.095684 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 19:07:07.095684 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 19:07:07.095684 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 19:07:07.095684 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 17 19:07:07.095684 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 17 19:07:07.095684 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 17 19:07:07.095684 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 17 19:07:07.095684 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 19:07:07.095684 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 19:07:07.095684 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 19:07:07.095684 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 19:07:07.095684 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 19:07:07.095684 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 19:07:07.096574 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 19:07:07.096574 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application with Lock( Aug 17 19:07:07.096574 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 19:07:07.096574 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return self._enter() Aug 17 19:07:07.096574 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 19:07:07.096574 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 19:07:07.096574 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 19:07:07.096574 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return self.creator() Aug 17 19:07:07.096574 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 19:07:07.096574 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application created_value = creator( Aug 17 19:07:07.096574 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 17 19:07:07.096574 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 17 19:07:07.096574 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 17 19:07:07.096574 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application Aug 17 19:07:07.096574 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: [pid: 88550|app: 0|req: 400/785] 10.222.0.26 () {56 vars in 1114 bytes} [Wed Aug 17 19:07:06 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 17 19:07:07.101466 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66b77e24-216d-445f-b6e4-da96f46a87b3 None admin] Authenticating user token {{(pid=88550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:07:07.120928 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61ce000c-c041-4ecb-b07b-b996db02ef4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '819d41a279e64291acc60de51e1530ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:07:07.121525 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ce000c-c041-4ecb-b07b-b996db02ef4f None admin] REQUEST_METHOD: `GET` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:07:07.121799 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ce000c-c041-4ecb-b07b-b996db02ef4f None admin] SCRIPT_NAME: `/identity` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:07:07.122100 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ce000c-c041-4ecb-b07b-b996db02ef4f None admin] PATH_INFO: `/v3/services` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:07:07.122756 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61ce000c-c041-4ecb-b07b-b996db02ef4f None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=88551) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 19:07:07.123055 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61ce000c-c041-4ecb-b07b-b996db02ef4f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:07:07.124400 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61ce000c-c041-4ecb-b07b-b996db02ef4f None admin] RBAC: Authorization granted {{(pid=88551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:07:07.129287 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: [pid: 88551|app: 0|req: 386/786] 10.222.0.26 () {56 vars in 1126 bytes} [Wed Aug 17 19:07:06 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 17 19:07:07.134986 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61ce000c-c041-4ecb-b07b-b996db02ef4f None admin] Authenticating user token {{(pid=88551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:07:07.196375 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG dbcounter [-] [88551] Writing DB stats keystone:SELECT=100 {{(pid=88551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:07:07.203074 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66b77e24-216d-445f-b6e4-da96f46a87b3 None admin] Validating token access rules against request {{(pid=88550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:07:07.226819 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG dbcounter [-] [88550] Writing DB stats keystone:SELECT=100 {{(pid=88550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:07:07.236305 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61ce000c-c041-4ecb-b07b-b996db02ef4f None admin] Validating token access rules against request {{(pid=88551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:07:07.238730 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cfee1a7-b2f2-4375-9ec1-cd8cdc893abe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '819d41a279e64291acc60de51e1530ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:07:07.239330 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cfee1a7-b2f2-4375-9ec1-cd8cdc893abe None admin] REQUEST_METHOD: `GET` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:07:07.239608 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cfee1a7-b2f2-4375-9ec1-cd8cdc893abe None admin] SCRIPT_NAME: `/identity` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:07:07.239878 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cfee1a7-b2f2-4375-9ec1-cd8cdc893abe None admin] PATH_INFO: `/v3/services` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:07:07.240505 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cfee1a7-b2f2-4375-9ec1-cd8cdc893abe None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=88550) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 19:07:07.240808 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cfee1a7-b2f2-4375-9ec1-cd8cdc893abe None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:07:07.242292 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cfee1a7-b2f2-4375-9ec1-cd8cdc893abe None admin] RBAC: Authorization granted {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:07:07.247340 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: [pid: 88550|app: 0|req: 401/787] 10.222.0.26 () {56 vars in 1114 bytes} [Wed Aug 17 19:07:07 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 17 19:07:07.253038 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cfee1a7-b2f2-4375-9ec1-cd8cdc893abe None admin] Authenticating user token {{(pid=88550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:07:07.270571 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb46178e-b7e5-4c72-ae78-4cad8f3af26e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '819d41a279e64291acc60de51e1530ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:07:07.271176 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb46178e-b7e5-4c72-ae78-4cad8f3af26e None admin] REQUEST_METHOD: `POST` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:07:07.271458 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb46178e-b7e5-4c72-ae78-4cad8f3af26e None admin] SCRIPT_NAME: `/identity` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:07:07.271727 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb46178e-b7e5-4c72-ae78-4cad8f3af26e None admin] PATH_INFO: `/v3/endpoints` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:07:07.272393 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb46178e-b7e5-4c72-ae78-4cad8f3af26e None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=88551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:07:07.273789 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb46178e-b7e5-4c72-ae78-4cad8f3af26e None admin] RBAC: Authorization granted {{(pid=88551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:07:07.353658 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cfee1a7-b2f2-4375-9ec1-cd8cdc893abe None admin] Validating token access rules against request {{(pid=88550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:07:07.354359 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: [pid: 88551|app: 0|req: 387/788] 10.222.0.26 () {60 vars in 1144 bytes} [Wed Aug 17 19:07:07 2022] POST /identity/v3/endpoints => generated 347 bytes in 220 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 17 19:07:07.401137 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6535fff0-750a-4638-a559-b7b6dca79547 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '819d41a279e64291acc60de51e1530ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:07:07.401736 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6535fff0-750a-4638-a559-b7b6dca79547 None admin] REQUEST_METHOD: `GET` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:07:07.402008 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6535fff0-750a-4638-a559-b7b6dca79547 None admin] SCRIPT_NAME: `/identity` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:07:07.402271 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6535fff0-750a-4638-a559-b7b6dca79547 None admin] PATH_INFO: `/v3/services` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:07:07.402955 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6535fff0-750a-4638-a559-b7b6dca79547 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=88550) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 19:07:07.403877 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6535fff0-750a-4638-a559-b7b6dca79547 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:07:07.405291 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6535fff0-750a-4638-a559-b7b6dca79547 None admin] RBAC: Authorization granted {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:07:07.410778 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: [pid: 88550|app: 0|req: 402/789] 10.222.0.26 () {56 vars in 1114 bytes} [Wed Aug 17 19:07:07 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 17 19:07:07.417180 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb46178e-b7e5-4c72-ae78-4cad8f3af26e None admin] Authenticating user token {{(pid=88551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:07:07.531827 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb46178e-b7e5-4c72-ae78-4cad8f3af26e None admin] Validating token access rules against request {{(pid=88551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:07:07.549159 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG dbcounter [-] [88551] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:07:07.566249 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-857eecd9-8412-4d3c-8943-36080d778b68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '819d41a279e64291acc60de51e1530ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:07:07.566928 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-857eecd9-8412-4d3c-8943-36080d778b68 None admin] REQUEST_METHOD: `POST` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:07:07.567204 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-857eecd9-8412-4d3c-8943-36080d778b68 None admin] SCRIPT_NAME: `/identity` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:07:07.567471 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-857eecd9-8412-4d3c-8943-36080d778b68 None admin] PATH_INFO: `/v3/endpoints` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:07:07.568118 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-857eecd9-8412-4d3c-8943-36080d778b68 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=88551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:07:07.569508 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-857eecd9-8412-4d3c-8943-36080d778b68 None admin] RBAC: Authorization granted {{(pid=88551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:07:07.652579 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: [pid: 88551|app: 0|req: 388/790] 10.222.0.26 () {60 vars in 1144 bytes} [Wed Aug 17 19:07:07 2022] POST /identity/v3/endpoints => generated 346 bytes in 230 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 19:07:09.600951 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a15cd4a5-8cb2-4ac8-a4fb-af58f863c910 None None] REQUEST_METHOD: `GET` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:07:09.601507 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a15cd4a5-8cb2-4ac8-a4fb-af58f863c910 None None] SCRIPT_NAME: `/identity` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:07:09.601507 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a15cd4a5-8cb2-4ac8-a4fb-af58f863c910 None None] PATH_INFO: `/` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:07:09.603022 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: [pid: 88550|app: 0|req: 403/791] 10.222.0.26 () {54 vars in 927 bytes} [Wed Aug 17 19:07:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 19:07:09.608517 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc24b266-180b-4637-be95-0a8cf49b23ec None None] REQUEST_METHOD: `POST` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:07:09.608922 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc24b266-180b-4637-be95-0a8cf49b23ec None None] SCRIPT_NAME: `/identity` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:07:09.609198 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc24b266-180b-4637-be95-0a8cf49b23ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:07:09.627533 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.auth.core [None req-dc24b266-180b-4637-be95-0a8cf49b23ec None None] MFA Rules not processed for user `819d41a279e64291acc60de51e1530ae`. Rule list: `[]` (Enabled: `True`). {{(pid=88551) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 19:07:09.628787 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.common.fernet_utils [None req-dc24b266-180b-4637-be95-0a8cf49b23ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:07:09.707021 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: [pid: 88551|app: 0|req: 389/792] 10.222.0.26 () {58 vars in 1024 bytes} [Wed Aug 17 19:07:09 2022] POST /identity/v3/auth/tokens => generated 1617 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 17 19:07:09.861861 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3513c8b8-7c07-4805-a104-c03b07adf9cf None None] REQUEST_METHOD: `GET` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:07:09.862062 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3513c8b8-7c07-4805-a104-c03b07adf9cf None None] SCRIPT_NAME: `/identity` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:07:09.862324 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3513c8b8-7c07-4805-a104-c03b07adf9cf None None] PATH_INFO: `/` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:07:09.863677 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: [pid: 88550|app: 0|req: 404/793] 10.222.0.26 () {54 vars in 927 bytes} [Wed Aug 17 19:07:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 19:07:09.868885 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f4e7de-abe5-4eec-801c-8e5d2555a594 None None] REQUEST_METHOD: `POST` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:07:09.869259 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f4e7de-abe5-4eec-801c-8e5d2555a594 None None] SCRIPT_NAME: `/identity` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:07:09.869538 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f4e7de-abe5-4eec-801c-8e5d2555a594 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:07:09.887955 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.auth.core [None req-f8f4e7de-abe5-4eec-801c-8e5d2555a594 None None] MFA Rules not processed for user `819d41a279e64291acc60de51e1530ae`. Rule list: `[]` (Enabled: `True`). {{(pid=88551) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 19:07:09.889155 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.common.fernet_utils [None req-f8f4e7de-abe5-4eec-801c-8e5d2555a594 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:07:09.958851 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: [pid: 88551|app: 0|req: 390/794] 10.222.0.26 () {58 vars in 1024 bytes} [Wed Aug 17 19:07:09 2022] POST /identity/v3/auth/tokens => generated 1617 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 17 19:07:10.037694 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3513c8b8-7c07-4805-a104-c03b07adf9cf None None] Authenticating user token {{(pid=88550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:07:10.087976 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG dbcounter [-] [88550] Writing DB stats keystone:SELECT=100 {{(pid=88550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:07:10.138092 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3513c8b8-7c07-4805-a104-c03b07adf9cf None None] Validating token access rules against request {{(pid=88550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:07:10.169642 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e02f7da-ea5c-4640-a898-fbaf41d6a700 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '819d41a279e64291acc60de51e1530ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:07:10.170245 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e02f7da-ea5c-4640-a898-fbaf41d6a700 None admin] REQUEST_METHOD: `GET` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:07:10.170521 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e02f7da-ea5c-4640-a898-fbaf41d6a700 None admin] SCRIPT_NAME: `/identity` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:07:10.170820 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e02f7da-ea5c-4640-a898-fbaf41d6a700 None admin] PATH_INFO: `/v3/services/compute` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:07:10.171385 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e02f7da-ea5c-4640-a898-fbaf41d6a700 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:07:10.172728 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e02f7da-ea5c-4640-a898-fbaf41d6a700 None admin] RBAC: Authorization granted {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:07:10.181061 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application [None req-1e02f7da-ea5c-4640-a898-fbaf41d6a700 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Aug 17 19:07:10.181061 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 19:07:10.181061 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 17 19:07:10.181061 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 17 19:07:10.181061 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 17 19:07:10.181061 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 17 19:07:10.181061 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 17 19:07:10.181061 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 17 19:07:10.181061 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 17 19:07:10.181061 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application Aug 17 19:07:10.181061 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 17 19:07:10.181061 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application Aug 17 19:07:10.181061 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 19:07:10.181061 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 19:07:10.181061 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 19:07:10.181061 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 19:07:10.181061 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 19:07:10.186757 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 19:07:10.186757 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 19:07:10.186757 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 19:07:10.186757 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 19:07:10.186757 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 19:07:10.186757 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 19:07:10.186757 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 17 19:07:10.186757 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 17 19:07:10.186757 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 17 19:07:10.186757 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 17 19:07:10.186757 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 19:07:10.186757 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 19:07:10.186757 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 19:07:10.186757 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 19:07:10.186757 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 19:07:10.186757 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 19:07:10.187941 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 19:07:10.187941 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application with Lock( Aug 17 19:07:10.187941 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 19:07:10.187941 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return self._enter() Aug 17 19:07:10.187941 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 19:07:10.187941 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 19:07:10.187941 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 19:07:10.187941 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return self.creator() Aug 17 19:07:10.187941 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 19:07:10.187941 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application created_value = creator( Aug 17 19:07:10.187941 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 17 19:07:10.187941 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 17 19:07:10.187941 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 17 19:07:10.187941 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application Aug 17 19:07:10.187941 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: [pid: 88550|app: 0|req: 405/795] 10.222.0.26 () {56 vars in 1111 bytes} [Wed Aug 17 19:07:10 2022] GET /identity/v3/services/compute => generated 88 bytes in 145 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 19:07:10.188911 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8f4e7de-abe5-4eec-801c-8e5d2555a594 None None] Authenticating user token {{(pid=88551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:07:10.219870 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG dbcounter [-] [88551] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:07:10.291834 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8f4e7de-abe5-4eec-801c-8e5d2555a594 None None] Validating token access rules against request {{(pid=88551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:07:10.294202 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e02f7da-ea5c-4640-a898-fbaf41d6a700 None admin] Authenticating user token {{(pid=88550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:07:10.329395 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f98da285-4771-4d25-a4bb-44d43659abe9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '819d41a279e64291acc60de51e1530ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:07:10.330083 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f98da285-4771-4d25-a4bb-44d43659abe9 None admin] REQUEST_METHOD: `GET` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:07:10.330284 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f98da285-4771-4d25-a4bb-44d43659abe9 None admin] SCRIPT_NAME: `/identity` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:07:10.330528 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f98da285-4771-4d25-a4bb-44d43659abe9 None admin] PATH_INFO: `/v3/services` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:07:10.331180 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f98da285-4771-4d25-a4bb-44d43659abe9 None admin] RBAC: Adding query filter params (name=compute) {{(pid=88551) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 19:07:10.331481 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f98da285-4771-4d25-a4bb-44d43659abe9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:07:10.332830 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f98da285-4771-4d25-a4bb-44d43659abe9 None admin] RBAC: Authorization granted {{(pid=88551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:07:10.337535 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: [pid: 88551|app: 0|req: 391/796] 10.222.0.26 () {56 vars in 1112 bytes} [Wed Aug 17 19:07:10 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 19:07:10.343306 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f98da285-4771-4d25-a4bb-44d43659abe9 None admin] Authenticating user token {{(pid=88551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:07:10.398115 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e02f7da-ea5c-4640-a898-fbaf41d6a700 None admin] Validating token access rules against request {{(pid=88550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:07:10.410809 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG dbcounter [-] [88550] Writing DB stats keystone:SELECT=100 {{(pid=88550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:07:10.431704 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd878ee2-0d27-4440-905f-cf357a2fc3ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '819d41a279e64291acc60de51e1530ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:07:10.432443 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd878ee2-0d27-4440-905f-cf357a2fc3ff None admin] REQUEST_METHOD: `POST` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:07:10.432719 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd878ee2-0d27-4440-905f-cf357a2fc3ff None admin] SCRIPT_NAME: `/identity` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:07:10.433041 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd878ee2-0d27-4440-905f-cf357a2fc3ff None admin] PATH_INFO: `/v3/projects` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:07:10.433690 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd878ee2-0d27-4440-905f-cf357a2fc3ff None admin] RBAC: Authorizing `identity:create_project()` {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:07:10.436611 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd878ee2-0d27-4440-905f-cf357a2fc3ff None admin] RBAC: Authorization granted {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:07:10.439003 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG dbcounter [-] [88551] Writing DB stats keystone:SELECT=100 {{(pid=88551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:07:10.439277 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: WARNING keystone.server.flask.common [None req-dd878ee2-0d27-4440-905f-cf357a2fc3ff None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Aug 17 19:07:10.445807 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f98da285-4771-4d25-a4bb-44d43659abe9 None admin] Validating token access rules against request {{(pid=88551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:07:10.479372 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0dff96a-73fb-4d44-a248-e50ccd411b74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '819d41a279e64291acc60de51e1530ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:07:10.479961 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0dff96a-73fb-4d44-a248-e50ccd411b74 None admin] REQUEST_METHOD: `GET` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:07:10.480243 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0dff96a-73fb-4d44-a248-e50ccd411b74 None admin] SCRIPT_NAME: `/identity` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:07:10.480512 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0dff96a-73fb-4d44-a248-e50ccd411b74 None admin] PATH_INFO: `/v3/services` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:07:10.481137 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0dff96a-73fb-4d44-a248-e50ccd411b74 None admin] RBAC: Adding query filter params (type=compute) {{(pid=88551) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 19:07:10.481955 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0dff96a-73fb-4d44-a248-e50ccd411b74 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:07:10.483372 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0dff96a-73fb-4d44-a248-e50ccd411b74 None admin] RBAC: Authorization granted {{(pid=88551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:07:10.487646 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: [pid: 88551|app: 0|req: 392/797] 10.222.0.26 () {56 vars in 1112 bytes} [Wed Aug 17 19:07:10 2022] GET /identity/v3/services?type=compute => generated 124 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 17 19:07:10.497493 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.common.sql.core [None req-dd878ee2-0d27-4440-905f-cf357a2fc3ff None admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Aug 17 19:07:10.497493 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Aug 17 19:07:10.497493 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: [parameters: {'id': 'dc37f47b8a044fdf98ac77630a6b636d', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Aug 17 19:07:10.497493 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=88550) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Aug 17 19:07:10.514134 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application [None req-dd878ee2-0d27-4440-905f-cf357a2fc3ff None admin] Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id dc37f47b8a044fdf98ac77630a6b636d.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id dc37f47b8a044fdf98ac77630a6b636d. Aug 17 19:07:10.514134 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 19:07:10.514134 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Aug 17 19:07:10.514134 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 17 19:07:10.514134 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 17 19:07:10.514134 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 17 19:07:10.514134 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 17 19:07:10.514134 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application result = self._query(query) Aug 17 19:07:10.514134 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 17 19:07:10.514134 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application conn.query(q) Aug 17 19:07:10.514134 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 17 19:07:10.514134 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 17 19:07:10.514134 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 17 19:07:10.515162 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application result.read() Aug 17 19:07:10.515162 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 17 19:07:10.515162 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 17 19:07:10.515162 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 17 19:07:10.515162 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 17 19:07:10.515162 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 17 19:07:10.515162 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 17 19:07:10.515162 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 17 19:07:10.515162 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 17 19:07:10.515162 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Aug 17 19:07:10.515162 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application Aug 17 19:07:10.515162 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Aug 17 19:07:10.515162 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application Aug 17 19:07:10.515162 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 19:07:10.515162 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Aug 17 19:07:10.515162 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return method(*args, **kwargs) Aug 17 19:07:10.515162 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 241, in create_project Aug 17 19:07:10.515162 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return project_ref.to_dict() Aug 17 19:07:10.516232 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 17 19:07:10.516232 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application next(self.gen) Aug 17 19:07:10.516232 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Aug 17 19:07:10.516232 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application yield resource Aug 17 19:07:10.516232 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 17 19:07:10.516232 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application next(self.gen) Aug 17 19:07:10.516232 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Aug 17 19:07:10.516232 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application self.session.rollback() Aug 17 19:07:10.516232 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 17 19:07:10.516232 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application self.force_reraise() Aug 17 19:07:10.516232 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 17 19:07:10.516232 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application raise self.value Aug 17 19:07:10.516232 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Aug 17 19:07:10.516232 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Aug 17 19:07:10.516232 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Aug 17 19:07:10.516232 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application session.commit() Aug 17 19:07:10.516232 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Aug 17 19:07:10.517166 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Aug 17 19:07:10.517166 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Aug 17 19:07:10.517166 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application self._prepare_impl() Aug 17 19:07:10.517166 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Aug 17 19:07:10.517166 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application self.session.flush() Aug 17 19:07:10.517166 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Aug 17 19:07:10.517166 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application self._flush(objects) Aug 17 19:07:10.517166 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Aug 17 19:07:10.517166 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Aug 17 19:07:10.517166 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Aug 17 19:07:10.517166 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application compat.raise_( Aug 17 19:07:10.517166 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 17 19:07:10.517166 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application raise exception Aug 17 19:07:10.517166 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Aug 17 19:07:10.517166 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application flush_context.execute() Aug 17 19:07:10.517166 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Aug 17 19:07:10.517166 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application rec.execute(self) Aug 17 19:07:10.518152 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Aug 17 19:07:10.518152 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Aug 17 19:07:10.518152 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Aug 17 19:07:10.518152 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application _emit_insert_statements( Aug 17 19:07:10.518152 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Aug 17 19:07:10.518152 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application c = connection._execute_20( Aug 17 19:07:10.518152 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Aug 17 19:07:10.518152 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Aug 17 19:07:10.518152 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Aug 17 19:07:10.518152 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Aug 17 19:07:10.518152 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Aug 17 19:07:10.518152 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application ret = self._execute_context( Aug 17 19:07:10.518152 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Aug 17 19:07:10.518152 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Aug 17 19:07:10.518152 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Aug 17 19:07:10.519121 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Aug 17 19:07:10.519121 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 17 19:07:10.519121 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application raise exception Aug 17 19:07:10.519121 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Aug 17 19:07:10.519121 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 17 19:07:10.519121 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 17 19:07:10.519121 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 17 19:07:10.519121 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 17 19:07:10.519121 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application result = self._query(query) Aug 17 19:07:10.519121 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 17 19:07:10.519121 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application conn.query(q) Aug 17 19:07:10.519121 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 17 19:07:10.519121 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 17 19:07:10.519121 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 17 19:07:10.519121 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application result.read() Aug 17 19:07:10.519121 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 17 19:07:10.519121 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 17 19:07:10.520024 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 17 19:07:10.520024 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 17 19:07:10.520024 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 17 19:07:10.520024 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 17 19:07:10.520024 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 17 19:07:10.520024 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 17 19:07:10.520024 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Aug 17 19:07:10.520024 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Aug 17 19:07:10.520024 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application [parameters: {'id': 'dc37f47b8a044fdf98ac77630a6b636d', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Aug 17 19:07:10.520024 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Aug 17 19:07:10.520024 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application Aug 17 19:07:10.520024 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 17 19:07:10.520024 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application Aug 17 19:07:10.520024 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 19:07:10.520024 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 216, in create_project Aug 17 19:07:10.520845 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application ret = self.driver.create_project(project_id, project) Aug 17 19:07:10.520845 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Aug 17 19:07:10.520845 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Aug 17 19:07:10.520845 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - Duplicate entry found with name service at domain ID default. Aug 17 19:07:10.520845 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application Aug 17 19:07:10.520845 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 17 19:07:10.520845 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application Aug 17 19:07:10.520845 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 19:07:10.520845 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 19:07:10.520845 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 19:07:10.520845 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 19:07:10.520845 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 19:07:10.520845 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 19:07:10.520845 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 19:07:10.520845 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 19:07:10.520845 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 19:07:10.520845 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 19:07:10.521767 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 19:07:10.521767 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 176, in post Aug 17 19:07:10.521767 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application ref = PROVIDERS.resource_api.create_project( Aug 17 19:07:10.521767 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 19:07:10.521767 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 19:07:10.521767 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 218, in create_project Aug 17 19:07:10.521767 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application raise exception.Conflict( Aug 17 19:07:10.521767 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id dc37f47b8a044fdf98ac77630a6b636d. Aug 17 19:07:10.521767 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application Aug 17 19:07:10.521767 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: [pid: 88550|app: 0|req: 406/798] 10.222.0.26 () {60 vars in 1140 bytes} [Wed Aug 17 19:07:10 2022] POST /identity/v3/projects => generated 262 bytes in 222 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Aug 17 19:07:10.522350 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0dff96a-73fb-4d44-a248-e50ccd411b74 None admin] Authenticating user token {{(pid=88551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:07:10.632469 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0dff96a-73fb-4d44-a248-e50ccd411b74 None admin] Validating token access rules against request {{(pid=88551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:07:10.670454 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80d3973a-e5c4-47bd-aba5-2b372b1c8114 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '819d41a279e64291acc60de51e1530ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:07:10.671028 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d3973a-e5c4-47bd-aba5-2b372b1c8114 None admin] REQUEST_METHOD: `GET` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:07:10.671303 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d3973a-e5c4-47bd-aba5-2b372b1c8114 None admin] SCRIPT_NAME: `/identity` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:07:10.671573 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d3973a-e5c4-47bd-aba5-2b372b1c8114 None admin] PATH_INFO: `/v3/projects/service` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:07:10.678746 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80d3973a-e5c4-47bd-aba5-2b372b1c8114 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:07:10.680294 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80d3973a-e5c4-47bd-aba5-2b372b1c8114 None admin] RBAC: Authorization granted {{(pid=88551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:07:10.692226 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application [None req-80d3973a-e5c4-47bd-aba5-2b372b1c8114 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 17 19:07:10.692226 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 19:07:10.692226 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 19:07:10.692226 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 19:07:10.692226 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 19:07:10.692226 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 19:07:10.692226 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 19:07:10.692226 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 19:07:10.692226 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 19:07:10.692226 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 19:07:10.692226 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 19:07:10.692226 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 19:07:10.692226 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 17 19:07:10.692226 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 17 19:07:10.692226 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 17 19:07:10.693411 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 17 19:07:10.693411 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 19:07:10.693411 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 19:07:10.693411 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 19:07:10.693411 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 19:07:10.693411 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 19:07:10.693411 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 19:07:10.693411 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 19:07:10.693411 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application with Lock( Aug 17 19:07:10.693411 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 19:07:10.693411 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application return self._enter() Aug 17 19:07:10.693411 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 19:07:10.693411 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 19:07:10.693411 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 19:07:10.693411 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application return self.creator() Aug 17 19:07:10.693411 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 19:07:10.693411 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application created_value = creator( Aug 17 19:07:10.694529 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 17 19:07:10.694529 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 17 19:07:10.694529 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 17 19:07:10.694529 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 17 19:07:10.694529 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 17 19:07:10.694529 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 17 19:07:10.694529 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 17 19:07:10.694529 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application Aug 17 19:07:10.694529 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: [pid: 88551|app: 0|req: 393/799] 10.222.0.26 () {56 vars in 1111 bytes} [Wed Aug 17 19:07:10 2022] GET /identity/v3/projects/service => generated 88 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 19:07:10.701472 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd878ee2-0d27-4440-905f-cf357a2fc3ff None admin] Authenticating user token {{(pid=88550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:07:10.802131 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd878ee2-0d27-4440-905f-cf357a2fc3ff None admin] Validating token access rules against request {{(pid=88550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:07:10.835282 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96da39dc-a753-4daf-b301-28fb5b99a673 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '819d41a279e64291acc60de51e1530ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:07:10.835877 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96da39dc-a753-4daf-b301-28fb5b99a673 None admin] REQUEST_METHOD: `GET` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:07:10.836150 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96da39dc-a753-4daf-b301-28fb5b99a673 None admin] SCRIPT_NAME: `/identity` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:07:10.836416 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96da39dc-a753-4daf-b301-28fb5b99a673 None admin] PATH_INFO: `/v3/projects` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:07:10.837068 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96da39dc-a753-4daf-b301-28fb5b99a673 None admin] RBAC: Adding query filter params (name=service) {{(pid=88550) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 19:07:10.837365 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96da39dc-a753-4daf-b301-28fb5b99a673 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:07:10.839073 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96da39dc-a753-4daf-b301-28fb5b99a673 None admin] RBAC: Authorization granted {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:07:10.859869 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: [pid: 88550|app: 0|req: 407/800] 10.222.0.26 () {56 vars in 1112 bytes} [Wed Aug 17 19:07:10 2022] GET /identity/v3/projects?name=service => generated 411 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 19:07:12.673491 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc2f3c0-8637-4e7c-b29b-8e6844256592 None None] REQUEST_METHOD: `GET` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:07:12.674037 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc2f3c0-8637-4e7c-b29b-8e6844256592 None None] SCRIPT_NAME: `/identity` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:07:12.674037 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc2f3c0-8637-4e7c-b29b-8e6844256592 None None] PATH_INFO: `/` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:07:12.675400 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: [pid: 88551|app: 0|req: 394/801] 10.222.0.26 () {54 vars in 927 bytes} [Wed Aug 17 19:07:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 19:07:12.680722 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7917c9c-119a-444b-975d-fc70d58071ee None None] REQUEST_METHOD: `POST` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:07:12.681128 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7917c9c-119a-444b-975d-fc70d58071ee None None] SCRIPT_NAME: `/identity` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:07:12.681277 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7917c9c-119a-444b-975d-fc70d58071ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:07:12.699769 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.auth.core [None req-f7917c9c-119a-444b-975d-fc70d58071ee None None] MFA Rules not processed for user `819d41a279e64291acc60de51e1530ae`. Rule list: `[]` (Enabled: `True`). {{(pid=88550) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 19:07:12.701772 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.common.fernet_utils [None req-f7917c9c-119a-444b-975d-fc70d58071ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:07:12.724951 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG dbcounter [-] [88550] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:07:12.769103 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: [pid: 88550|app: 0|req: 408/802] 10.222.0.26 () {58 vars in 1024 bytes} [Wed Aug 17 19:07:12 2022] POST /identity/v3/auth/tokens => generated 1617 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 17 19:07:13.079405 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e12e3b-c387-4e1a-a38f-6b86dc9a507d None None] REQUEST_METHOD: `GET` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:07:13.079712 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e12e3b-c387-4e1a-a38f-6b86dc9a507d None None] SCRIPT_NAME: `/identity` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:07:13.080066 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e12e3b-c387-4e1a-a38f-6b86dc9a507d None None] PATH_INFO: `/` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:07:13.081577 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: [pid: 88551|app: 0|req: 395/803] 10.222.0.26 () {54 vars in 927 bytes} [Wed Aug 17 19:07:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 19:07:13.086908 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f732361d-9053-468e-ab06-2a6b5dbb0cfe None None] REQUEST_METHOD: `POST` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:07:13.087195 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f732361d-9053-468e-ab06-2a6b5dbb0cfe None None] SCRIPT_NAME: `/identity` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:07:13.087471 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f732361d-9053-468e-ab06-2a6b5dbb0cfe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:07:13.101618 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63e12e3b-c387-4e1a-a38f-6b86dc9a507d None None] Authenticating user token {{(pid=88551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:07:13.108498 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.auth.core [None req-f732361d-9053-468e-ab06-2a6b5dbb0cfe None None] MFA Rules not processed for user `819d41a279e64291acc60de51e1530ae`. Rule list: `[]` (Enabled: `True`). {{(pid=88550) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 19:07:13.110211 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.common.fernet_utils [None req-f732361d-9053-468e-ab06-2a6b5dbb0cfe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:07:13.125892 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG dbcounter [-] [88551] Writing DB stats keystone:SELECT=100 {{(pid=88551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:07:13.182732 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: [pid: 88550|app: 0|req: 409/804] 10.222.0.26 () {58 vars in 1024 bytes} [Wed Aug 17 19:07:13 2022] POST /identity/v3/auth/tokens => generated 1617 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 17 19:07:13.221171 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63e12e3b-c387-4e1a-a38f-6b86dc9a507d None None] Validating token access rules against request {{(pid=88551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:07:13.261627 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d36283a5-1f2a-443f-b8f6-5bba3ce912e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '819d41a279e64291acc60de51e1530ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:07:13.262275 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d36283a5-1f2a-443f-b8f6-5bba3ce912e1 None admin] REQUEST_METHOD: `POST` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:07:13.263155 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d36283a5-1f2a-443f-b8f6-5bba3ce912e1 None admin] SCRIPT_NAME: `/identity` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:07:13.263428 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d36283a5-1f2a-443f-b8f6-5bba3ce912e1 None admin] PATH_INFO: `/v3/services` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:07:13.264077 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d36283a5-1f2a-443f-b8f6-5bba3ce912e1 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=88551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:07:13.265419 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d36283a5-1f2a-443f-b8f6-5bba3ce912e1 None admin] RBAC: Authorization granted {{(pid=88551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:07:13.338601 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: [pid: 88551|app: 0|req: 396/805] 10.222.0.26 () {60 vars in 1141 bytes} [Wed Aug 17 19:07:13 2022] POST /identity/v3/services => generated 242 bytes in 236 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 17 19:07:13.510774 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f732361d-9053-468e-ab06-2a6b5dbb0cfe None None] Authenticating user token {{(pid=88550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:07:13.596567 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG dbcounter [-] [88550] Writing DB stats keystone:SELECT=100 {{(pid=88550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:07:13.608581 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f732361d-9053-468e-ab06-2a6b5dbb0cfe None None] Validating token access rules against request {{(pid=88550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:07:13.648293 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69bcd25c-27a5-4b82-b601-494f1fd2bde1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '819d41a279e64291acc60de51e1530ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:07:13.648897 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69bcd25c-27a5-4b82-b601-494f1fd2bde1 None admin] REQUEST_METHOD: `POST` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:07:13.649174 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69bcd25c-27a5-4b82-b601-494f1fd2bde1 None admin] SCRIPT_NAME: `/identity` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:07:13.649444 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69bcd25c-27a5-4b82-b601-494f1fd2bde1 None admin] PATH_INFO: `/v3/users` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:07:13.650068 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69bcd25c-27a5-4b82-b601-494f1fd2bde1 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:07:13.651568 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69bcd25c-27a5-4b82-b601-494f1fd2bde1 None admin] RBAC: Authorization granted {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:07:13.696589 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.common.sql.core [None req-69bcd25c-27a5-4b82-b601-494f1fd2bde1 None admin] Conflict user: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Aug 17 19:07:13.696589 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Aug 17 19:07:13.696589 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: [parameters: {'user_id': '6463156bb4094bff8d6d9540cf952750', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Aug 17 19:07:13.696589 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=88550) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Aug 17 19:07:13.703315 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application [None req-69bcd25c-27a5-4b82-b601-494f1fd2bde1 None admin] Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default.: keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Aug 17 19:07:13.703315 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 19:07:13.703315 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Aug 17 19:07:13.703315 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 17 19:07:13.703315 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 17 19:07:13.703315 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 17 19:07:13.703315 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 17 19:07:13.703315 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application result = self._query(query) Aug 17 19:07:13.703315 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 17 19:07:13.703315 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application conn.query(q) Aug 17 19:07:13.703315 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 17 19:07:13.703315 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 17 19:07:13.703315 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 17 19:07:13.703315 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application result.read() Aug 17 19:07:13.703315 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 17 19:07:13.704187 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 17 19:07:13.704187 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 17 19:07:13.704187 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 17 19:07:13.704187 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 17 19:07:13.704187 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 17 19:07:13.704187 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 17 19:07:13.704187 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 17 19:07:13.704187 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Aug 17 19:07:13.704187 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application Aug 17 19:07:13.704187 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Aug 17 19:07:13.704187 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application Aug 17 19:07:13.704187 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 19:07:13.704187 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Aug 17 19:07:13.704187 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return method(*args, **kwargs) Aug 17 19:07:13.704187 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 141, in create_user Aug 17 19:07:13.704187 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return base.filter_user(user_ref.to_dict()) Aug 17 19:07:13.704187 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 17 19:07:13.704187 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application next(self.gen) Aug 17 19:07:13.705397 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Aug 17 19:07:13.705397 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application yield resource Aug 17 19:07:13.705397 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 17 19:07:13.705397 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application next(self.gen) Aug 17 19:07:13.705397 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Aug 17 19:07:13.705397 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application self.session.rollback() Aug 17 19:07:13.705397 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 17 19:07:13.705397 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application self.force_reraise() Aug 17 19:07:13.705397 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 17 19:07:13.705397 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application raise self.value Aug 17 19:07:13.705397 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Aug 17 19:07:13.705397 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Aug 17 19:07:13.705397 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Aug 17 19:07:13.705397 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application session.commit() Aug 17 19:07:13.705397 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Aug 17 19:07:13.705397 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Aug 17 19:07:13.705397 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Aug 17 19:07:13.706947 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application self._prepare_impl() Aug 17 19:07:13.706947 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Aug 17 19:07:13.706947 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application self.session.flush() Aug 17 19:07:13.706947 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Aug 17 19:07:13.706947 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application self._flush(objects) Aug 17 19:07:13.706947 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Aug 17 19:07:13.706947 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Aug 17 19:07:13.706947 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Aug 17 19:07:13.706947 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application compat.raise_( Aug 17 19:07:13.706947 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 17 19:07:13.706947 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application raise exception Aug 17 19:07:13.706947 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Aug 17 19:07:13.706947 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application flush_context.execute() Aug 17 19:07:13.706947 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Aug 17 19:07:13.706947 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application rec.execute(self) Aug 17 19:07:13.706947 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Aug 17 19:07:13.706947 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Aug 17 19:07:13.708243 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Aug 17 19:07:13.708243 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application _emit_insert_statements( Aug 17 19:07:13.708243 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Aug 17 19:07:13.708243 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application result = connection._execute_20( Aug 17 19:07:13.708243 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Aug 17 19:07:13.708243 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Aug 17 19:07:13.708243 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Aug 17 19:07:13.708243 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Aug 17 19:07:13.708243 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Aug 17 19:07:13.708243 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application ret = self._execute_context( Aug 17 19:07:13.708243 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Aug 17 19:07:13.708243 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Aug 17 19:07:13.708243 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Aug 17 19:07:13.708243 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Aug 17 19:07:13.708243 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 17 19:07:13.708243 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application raise exception Aug 17 19:07:13.709474 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Aug 17 19:07:13.709474 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 17 19:07:13.709474 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 17 19:07:13.709474 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 17 19:07:13.709474 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 17 19:07:13.709474 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application result = self._query(query) Aug 17 19:07:13.709474 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 17 19:07:13.709474 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application conn.query(q) Aug 17 19:07:13.709474 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 17 19:07:13.709474 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 17 19:07:13.709474 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 17 19:07:13.709474 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application result.read() Aug 17 19:07:13.709474 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 17 19:07:13.709474 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 17 19:07:13.709474 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 17 19:07:13.709474 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 17 19:07:13.711219 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 17 19:07:13.711219 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 17 19:07:13.711219 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 17 19:07:13.711219 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 17 19:07:13.711219 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Aug 17 19:07:13.711219 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Aug 17 19:07:13.711219 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application [parameters: {'user_id': '6463156bb4094bff8d6d9540cf952750', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Aug 17 19:07:13.711219 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Aug 17 19:07:13.711219 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application Aug 17 19:07:13.711219 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 17 19:07:13.711219 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application Aug 17 19:07:13.711219 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 19:07:13.711219 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 19:07:13.711219 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 19:07:13.711219 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 19:07:13.712545 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 19:07:13.712545 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 19:07:13.712545 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 19:07:13.712545 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 19:07:13.712545 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 19:07:13.712545 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 19:07:13.712545 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 19:07:13.712545 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 244, in post Aug 17 19:07:13.712545 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.create_user( Aug 17 19:07:13.712545 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 19:07:13.712545 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 19:07:13.712545 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 17 19:07:13.712545 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 17 19:07:13.712545 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 17 19:07:13.712545 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 17 19:07:13.712545 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1000, in create_user Aug 17 19:07:13.712545 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application ref = self._create_user_with_federated_objects(user, driver) Aug 17 19:07:13.713688 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 966, in _create_user_with_federated_objects Aug 17 19:07:13.713688 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application user = driver.create_user(user['id'], user) Aug 17 19:07:13.713688 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Aug 17 19:07:13.713688 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Aug 17 19:07:13.713688 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Aug 17 19:07:13.713688 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application Aug 17 19:07:13.713688 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: [pid: 88550|app: 0|req: 410/806] 10.222.0.26 () {60 vars in 1131 bytes} [Wed Aug 17 19:07:13 2022] POST /identity/v3/users => generated 160 bytes in 194 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Aug 17 19:07:13.714153 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d36283a5-1f2a-443f-b8f6-5bba3ce912e1 None admin] Authenticating user token {{(pid=88551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:07:13.793264 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG dbcounter [-] [88551] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:07:13.816248 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d36283a5-1f2a-443f-b8f6-5bba3ce912e1 None admin] Validating token access rules against request {{(pid=88551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:07:13.849855 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3f7773d-ba38-4ae0-87e7-ba083e0004da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '819d41a279e64291acc60de51e1530ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:07:13.850487 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f7773d-ba38-4ae0-87e7-ba083e0004da None admin] REQUEST_METHOD: `GET` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:07:13.851100 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f7773d-ba38-4ae0-87e7-ba083e0004da None admin] SCRIPT_NAME: `/identity` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:07:13.851603 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f7773d-ba38-4ae0-87e7-ba083e0004da None admin] PATH_INFO: `/v3/users/cinder` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:07:13.860077 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3f7773d-ba38-4ae0-87e7-ba083e0004da None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=88551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:07:13.861552 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3f7773d-ba38-4ae0-87e7-ba083e0004da None admin] RBAC: Authorization granted {{(pid=88551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:07:13.872505 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application [None req-c3f7773d-ba38-4ae0-87e7-ba083e0004da None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Aug 17 19:07:13.872505 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 19:07:13.872505 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 19:07:13.872505 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 19:07:13.872505 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 19:07:13.872505 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 19:07:13.872505 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 19:07:13.872505 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 19:07:13.872505 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 19:07:13.872505 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 19:07:13.872505 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 19:07:13.872505 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 19:07:13.872505 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 17 19:07:13.872505 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 17 19:07:13.872505 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 17 19:07:13.872505 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 17 19:07:13.873501 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 19:07:13.873501 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 19:07:13.873501 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 17 19:07:13.873501 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 17 19:07:13.873501 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 17 19:07:13.873501 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 17 19:07:13.873501 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 19:07:13.873501 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 19:07:13.873501 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 19:07:13.873501 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 19:07:13.873501 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 19:07:13.873501 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application with Lock( Aug 17 19:07:13.873501 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 19:07:13.873501 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application return self._enter() Aug 17 19:07:13.873501 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 19:07:13.873501 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 19:07:13.873501 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 19:07:13.873501 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application return self.creator() Aug 17 19:07:13.874527 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 19:07:13.874527 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application created_value = creator( Aug 17 19:07:13.874527 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 17 19:07:13.874527 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 17 19:07:13.874527 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 17 19:07:13.874527 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 17 19:07:13.874527 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 17 19:07:13.874527 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 17 19:07:13.874527 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Aug 17 19:07:13.874527 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application Aug 17 19:07:13.874527 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: [pid: 88551|app: 0|req: 397/807] 10.222.0.26 () {56 vars in 1099 bytes} [Wed Aug 17 19:07:13 2022] GET /identity/v3/users/cinder => generated 84 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 19:07:13.879635 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69bcd25c-27a5-4b82-b601-494f1fd2bde1 None admin] Authenticating user token {{(pid=88550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:07:13.983257 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69bcd25c-27a5-4b82-b601-494f1fd2bde1 None admin] Validating token access rules against request {{(pid=88550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:07:14.016465 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-649b3541-807d-4272-b69c-f45cb278491a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '819d41a279e64291acc60de51e1530ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:07:14.017066 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-649b3541-807d-4272-b69c-f45cb278491a None admin] REQUEST_METHOD: `GET` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:07:14.017346 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-649b3541-807d-4272-b69c-f45cb278491a None admin] SCRIPT_NAME: `/identity` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:07:14.017618 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-649b3541-807d-4272-b69c-f45cb278491a None admin] PATH_INFO: `/v3/users` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:07:14.018325 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-649b3541-807d-4272-b69c-f45cb278491a None admin] RBAC: Adding query filter params (name=cinder) {{(pid=88550) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 19:07:14.018660 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-649b3541-807d-4272-b69c-f45cb278491a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:07:14.020292 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-649b3541-807d-4272-b69c-f45cb278491a None admin] RBAC: Authorization granted {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:07:14.058321 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: [pid: 88550|app: 0|req: 411/808] 10.222.0.26 () {56 vars in 1101 bytes} [Wed Aug 17 19:07:13 2022] GET /identity/v3/users?name=cinder => generated 354 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 19:07:15.541864 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d09897-3d67-4d3f-b5f5-118fed930adf None None] REQUEST_METHOD: `GET` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:07:15.542396 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d09897-3d67-4d3f-b5f5-118fed930adf None None] SCRIPT_NAME: `/identity` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:07:15.542486 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d09897-3d67-4d3f-b5f5-118fed930adf None None] PATH_INFO: `/` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:07:15.543829 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: [pid: 88551|app: 0|req: 398/809] 10.222.0.26 () {54 vars in 927 bytes} [Wed Aug 17 19:07:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 19:07:15.549035 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e6bbe44-0c5e-4668-8173-3f8aee640d77 None None] REQUEST_METHOD: `POST` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:07:15.549469 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e6bbe44-0c5e-4668-8173-3f8aee640d77 None None] SCRIPT_NAME: `/identity` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:07:15.549592 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e6bbe44-0c5e-4668-8173-3f8aee640d77 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:07:15.556970 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG dbcounter [-] [88550] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=88550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:07:15.568523 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.auth.core [None req-3e6bbe44-0c5e-4668-8173-3f8aee640d77 None None] MFA Rules not processed for user `819d41a279e64291acc60de51e1530ae`. Rule list: `[]` (Enabled: `True`). {{(pid=88550) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 19:07:15.570027 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.common.fernet_utils [None req-3e6bbe44-0c5e-4668-8173-3f8aee640d77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:07:15.634365 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: [pid: 88550|app: 0|req: 412/810] 10.222.0.26 () {58 vars in 1024 bytes} [Wed Aug 17 19:07:15 2022] POST /identity/v3/auth/tokens => generated 1713 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 17 19:07:15.955616 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78d09897-3d67-4d3f-b5f5-118fed930adf None None] Authenticating user token {{(pid=88551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:07:16.057191 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78d09897-3d67-4d3f-b5f5-118fed930adf None None] Validating token access rules against request {{(pid=88551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:07:16.090219 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-892756db-b491-4c21-8141-2e534c9086c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '819d41a279e64291acc60de51e1530ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:07:16.091373 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-892756db-b491-4c21-8141-2e534c9086c0 None admin] REQUEST_METHOD: `GET` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:07:16.091654 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-892756db-b491-4c21-8141-2e534c9086c0 None admin] SCRIPT_NAME: `/identity` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:07:16.091924 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-892756db-b491-4c21-8141-2e534c9086c0 None admin] PATH_INFO: `/v3/services/compute` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:07:16.092501 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-892756db-b491-4c21-8141-2e534c9086c0 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=88551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:07:16.093858 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-892756db-b491-4c21-8141-2e534c9086c0 None admin] RBAC: Authorization granted {{(pid=88551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:07:16.102511 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application [None req-892756db-b491-4c21-8141-2e534c9086c0 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Aug 17 19:07:16.102511 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 19:07:16.102511 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 17 19:07:16.102511 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 17 19:07:16.102511 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 17 19:07:16.102511 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 17 19:07:16.102511 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 17 19:07:16.102511 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 17 19:07:16.102511 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 17 19:07:16.102511 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application Aug 17 19:07:16.102511 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 17 19:07:16.102511 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application Aug 17 19:07:16.102511 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 19:07:16.102511 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 19:07:16.102511 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 19:07:16.102511 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 19:07:16.102511 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 19:07:16.103895 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 19:07:16.103895 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 19:07:16.103895 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 19:07:16.103895 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 19:07:16.103895 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 19:07:16.103895 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 19:07:16.103895 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 17 19:07:16.103895 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 17 19:07:16.103895 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 17 19:07:16.103895 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 17 19:07:16.103895 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 19:07:16.103895 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 19:07:16.103895 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 19:07:16.103895 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 19:07:16.103895 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 19:07:16.103895 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 19:07:16.104863 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 19:07:16.104863 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application with Lock( Aug 17 19:07:16.104863 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 19:07:16.104863 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application return self._enter() Aug 17 19:07:16.104863 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 19:07:16.104863 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 19:07:16.104863 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 19:07:16.104863 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application return self.creator() Aug 17 19:07:16.104863 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 19:07:16.104863 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application created_value = creator( Aug 17 19:07:16.104863 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 17 19:07:16.104863 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 17 19:07:16.104863 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 17 19:07:16.104863 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application Aug 17 19:07:16.104863 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: [pid: 88551|app: 0|req: 399/811] 10.222.0.26 () {56 vars in 1111 bytes} [Wed Aug 17 19:07:15 2022] GET /identity/v3/services/compute => generated 88 bytes in 148 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 19:07:16.110191 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e6bbe44-0c5e-4668-8173-3f8aee640d77 None None] Authenticating user token {{(pid=88550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:07:16.207201 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e6bbe44-0c5e-4668-8173-3f8aee640d77 None None] Validating token access rules against request {{(pid=88550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:07:16.239929 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98b5eb42-5e83-4e87-945d-58438857fcd4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '819d41a279e64291acc60de51e1530ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:07:16.240527 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b5eb42-5e83-4e87-945d-58438857fcd4 None admin] REQUEST_METHOD: `GET` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:07:16.240807 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b5eb42-5e83-4e87-945d-58438857fcd4 None admin] SCRIPT_NAME: `/identity` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:07:16.241077 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b5eb42-5e83-4e87-945d-58438857fcd4 None admin] PATH_INFO: `/v3/services` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:07:16.241700 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98b5eb42-5e83-4e87-945d-58438857fcd4 None admin] RBAC: Adding query filter params (name=compute) {{(pid=88550) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 19:07:16.242001 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98b5eb42-5e83-4e87-945d-58438857fcd4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:07:16.243420 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98b5eb42-5e83-4e87-945d-58438857fcd4 None admin] RBAC: Authorization granted {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:07:16.244606 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG dbcounter [-] [88550] Writing DB stats keystone:SELECT=100 {{(pid=88550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:07:16.249044 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: [pid: 88550|app: 0|req: 413/812] 10.222.0.26 () {56 vars in 1112 bytes} [Wed Aug 17 19:07:16 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 19:07:16.254827 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-892756db-b491-4c21-8141-2e534c9086c0 None admin] Authenticating user token {{(pid=88551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:07:16.258201 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG dbcounter [-] [88551] Writing DB stats keystone:SELECT=100 {{(pid=88551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:07:16.353560 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-892756db-b491-4c21-8141-2e534c9086c0 None admin] Validating token access rules against request {{(pid=88551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:07:16.386508 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f16cbd86-3551-4ac0-a723-2e2beebe1e4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '819d41a279e64291acc60de51e1530ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:07:16.387150 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f16cbd86-3551-4ac0-a723-2e2beebe1e4f None admin] REQUEST_METHOD: `GET` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:07:16.387468 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f16cbd86-3551-4ac0-a723-2e2beebe1e4f None admin] SCRIPT_NAME: `/identity` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:07:16.388232 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f16cbd86-3551-4ac0-a723-2e2beebe1e4f None admin] PATH_INFO: `/v3/services` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:07:16.388856 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f16cbd86-3551-4ac0-a723-2e2beebe1e4f None admin] RBAC: Adding query filter params (type=compute) {{(pid=88551) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 19:07:16.389158 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f16cbd86-3551-4ac0-a723-2e2beebe1e4f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:07:16.390511 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f16cbd86-3551-4ac0-a723-2e2beebe1e4f None admin] RBAC: Authorization granted {{(pid=88551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:07:16.395268 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: [pid: 88551|app: 0|req: 400/813] 10.222.0.26 () {56 vars in 1112 bytes} [Wed Aug 17 19:07:16 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 19:07:16.401328 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98b5eb42-5e83-4e87-945d-58438857fcd4 None admin] Authenticating user token {{(pid=88550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:07:16.500716 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98b5eb42-5e83-4e87-945d-58438857fcd4 None admin] Validating token access rules against request {{(pid=88550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:07:16.533789 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b5c42de-b6f6-4d62-a6a5-ff009875e5bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '819d41a279e64291acc60de51e1530ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:07:16.534376 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b5c42de-b6f6-4d62-a6a5-ff009875e5bb None admin] REQUEST_METHOD: `GET` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:07:16.534686 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b5c42de-b6f6-4d62-a6a5-ff009875e5bb None admin] SCRIPT_NAME: `/identity` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:07:16.534989 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b5c42de-b6f6-4d62-a6a5-ff009875e5bb None admin] PATH_INFO: `/v3/endpoints` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:07:16.535776 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b5c42de-b6f6-4d62-a6a5-ff009875e5bb None admin] RBAC: Adding query filter params (interface=public, service_id=8cbf6ddb9a1c41e9a5b7986b27425a42, region_id=RegionOne) {{(pid=88550) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 19:07:16.536080 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b5c42de-b6f6-4d62-a6a5-ff009875e5bb None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:07:16.537437 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b5c42de-b6f6-4d62-a6a5-ff009875e5bb None admin] RBAC: Authorization granted {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:07:16.542462 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: [pid: 88550|app: 0|req: 414/814] 10.222.0.26 () {56 vars in 1251 bytes} [Wed Aug 17 19:07:16 2022] GET /identity/v3/endpoints?service_id=8cbf6ddb9a1c41e9a5b7986b27425a42&interface=public®ion_id=RegionOne => generated 194 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 19:07:16.548993 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f16cbd86-3551-4ac0-a723-2e2beebe1e4f None admin] Authenticating user token {{(pid=88551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:07:16.616159 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG dbcounter [-] [88551] Writing DB stats keystone:SELECT=100 {{(pid=88551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:07:16.650646 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f16cbd86-3551-4ac0-a723-2e2beebe1e4f None admin] Validating token access rules against request {{(pid=88551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:07:16.685127 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6409f94a-ca98-4b11-b51f-11a2e7a6fc46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '819d41a279e64291acc60de51e1530ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:07:16.685717 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6409f94a-ca98-4b11-b51f-11a2e7a6fc46 None admin] REQUEST_METHOD: `GET` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:07:16.685994 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6409f94a-ca98-4b11-b51f-11a2e7a6fc46 None admin] SCRIPT_NAME: `/identity` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:07:16.686270 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6409f94a-ca98-4b11-b51f-11a2e7a6fc46 None admin] PATH_INFO: `/v3/services` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:07:16.687176 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6409f94a-ca98-4b11-b51f-11a2e7a6fc46 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:07:16.688537 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6409f94a-ca98-4b11-b51f-11a2e7a6fc46 None admin] RBAC: Authorization granted {{(pid=88551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:07:16.694607 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: [pid: 88551|app: 0|req: 401/815] 10.222.0.26 () {56 vars in 1087 bytes} [Wed Aug 17 19:07:16 2022] GET /identity/v3/services => generated 1728 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 19:07:18.845724 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f4f305f-4820-46ce-8dc5-46e68ce49111 None None] REQUEST_METHOD: `GET` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:07:18.846290 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f4f305f-4820-46ce-8dc5-46e68ce49111 None None] SCRIPT_NAME: `/identity` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:07:18.846290 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f4f305f-4820-46ce-8dc5-46e68ce49111 None None] PATH_INFO: `/` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:07:18.847653 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: [pid: 88550|app: 0|req: 415/816] 10.222.0.26 () {54 vars in 927 bytes} [Wed Aug 17 19:07:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 19:07:18.852614 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bad3b61-1eef-4630-aefa-47bcc67b3065 None None] REQUEST_METHOD: `POST` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:07:18.853031 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bad3b61-1eef-4630-aefa-47bcc67b3065 None None] SCRIPT_NAME: `/identity` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:07:18.853165 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bad3b61-1eef-4630-aefa-47bcc67b3065 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:07:18.871374 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.auth.core [None req-9bad3b61-1eef-4630-aefa-47bcc67b3065 None None] MFA Rules not processed for user `819d41a279e64291acc60de51e1530ae`. Rule list: `[]` (Enabled: `True`). {{(pid=88551) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 19:07:18.873172 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.common.fernet_utils [None req-9bad3b61-1eef-4630-aefa-47bcc67b3065 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:07:18.941079 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: [pid: 88551|app: 0|req: 402/817] 10.222.0.26 () {58 vars in 1024 bytes} [Wed Aug 17 19:07:18 2022] POST /identity/v3/auth/tokens => generated 1713 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 17 19:07:19.268341 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f4f305f-4820-46ce-8dc5-46e68ce49111 None None] Authenticating user token {{(pid=88550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:07:19.330865 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG dbcounter [-] [88550] Writing DB stats keystone:SELECT=100 {{(pid=88550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:07:19.369853 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f4f305f-4820-46ce-8dc5-46e68ce49111 None None] Validating token access rules against request {{(pid=88550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:07:19.403708 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98acedd7-9999-495e-920f-41a740094e1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '819d41a279e64291acc60de51e1530ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:07:19.404400 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98acedd7-9999-495e-920f-41a740094e1f None admin] REQUEST_METHOD: `GET` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:07:19.404677 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98acedd7-9999-495e-920f-41a740094e1f None admin] SCRIPT_NAME: `/identity` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:07:19.404942 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98acedd7-9999-495e-920f-41a740094e1f None admin] PATH_INFO: `/v3/services/compute` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:07:19.405513 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98acedd7-9999-495e-920f-41a740094e1f None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:07:19.406896 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98acedd7-9999-495e-920f-41a740094e1f None admin] RBAC: Authorization granted {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:07:19.415456 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application [None req-98acedd7-9999-495e-920f-41a740094e1f None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Aug 17 19:07:19.415456 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 19:07:19.415456 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 17 19:07:19.415456 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 17 19:07:19.415456 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 17 19:07:19.415456 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 17 19:07:19.415456 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 17 19:07:19.415456 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 17 19:07:19.415456 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 17 19:07:19.415456 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application Aug 17 19:07:19.415456 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 17 19:07:19.415456 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application Aug 17 19:07:19.415456 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 19:07:19.415456 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 19:07:19.415456 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 19:07:19.415456 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 19:07:19.415456 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 19:07:19.416633 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 19:07:19.416633 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 19:07:19.416633 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 19:07:19.416633 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 19:07:19.416633 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 19:07:19.416633 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 19:07:19.416633 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 17 19:07:19.416633 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 17 19:07:19.416633 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 17 19:07:19.416633 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 17 19:07:19.416633 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 19:07:19.416633 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 19:07:19.416633 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 19:07:19.416633 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 19:07:19.416633 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 19:07:19.416633 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 19:07:19.417655 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 19:07:19.417655 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application with Lock( Aug 17 19:07:19.417655 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 19:07:19.417655 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return self._enter() Aug 17 19:07:19.417655 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 19:07:19.417655 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 19:07:19.417655 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 19:07:19.417655 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return self.creator() Aug 17 19:07:19.417655 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 19:07:19.417655 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application created_value = creator( Aug 17 19:07:19.417655 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 17 19:07:19.417655 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 17 19:07:19.417655 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 17 19:07:19.417655 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application Aug 17 19:07:19.417655 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: [pid: 88550|app: 0|req: 416/818] 10.222.0.26 () {56 vars in 1111 bytes} [Wed Aug 17 19:07:19 2022] GET /identity/v3/services/compute => generated 88 bytes in 149 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 19:07:19.422709 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bad3b61-1eef-4630-aefa-47bcc67b3065 None None] Authenticating user token {{(pid=88551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:07:19.481415 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG dbcounter [-] [88551] Writing DB stats keystone:SELECT=100 {{(pid=88551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:07:19.522593 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bad3b61-1eef-4630-aefa-47bcc67b3065 None None] Validating token access rules against request {{(pid=88551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:07:19.555664 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-421e23b6-df89-48f0-b5a6-038f94b3759e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '819d41a279e64291acc60de51e1530ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:07:19.556247 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-421e23b6-df89-48f0-b5a6-038f94b3759e None admin] REQUEST_METHOD: `GET` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:07:19.556524 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-421e23b6-df89-48f0-b5a6-038f94b3759e None admin] SCRIPT_NAME: `/identity` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:07:19.556791 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-421e23b6-df89-48f0-b5a6-038f94b3759e None admin] PATH_INFO: `/v3/services` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:07:19.557415 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-421e23b6-df89-48f0-b5a6-038f94b3759e None admin] RBAC: Adding query filter params (name=compute) {{(pid=88551) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 19:07:19.557716 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-421e23b6-df89-48f0-b5a6-038f94b3759e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:07:19.559159 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-421e23b6-df89-48f0-b5a6-038f94b3759e None admin] RBAC: Authorization granted {{(pid=88551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:07:19.563988 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: [pid: 88551|app: 0|req: 403/819] 10.222.0.26 () {56 vars in 1112 bytes} [Wed Aug 17 19:07:19 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 19:07:19.569843 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98acedd7-9999-495e-920f-41a740094e1f None admin] Authenticating user token {{(pid=88550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:07:19.666270 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98acedd7-9999-495e-920f-41a740094e1f None admin] Validating token access rules against request {{(pid=88550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:07:19.691599 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG dbcounter [-] [88550] Writing DB stats keystone:SELECT=100 {{(pid=88550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:07:19.700522 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-445e9102-340b-48a0-95fa-881f5c9a3c8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '819d41a279e64291acc60de51e1530ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:07:19.701111 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-445e9102-340b-48a0-95fa-881f5c9a3c8e None admin] REQUEST_METHOD: `GET` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:07:19.702629 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-445e9102-340b-48a0-95fa-881f5c9a3c8e None admin] SCRIPT_NAME: `/identity` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:07:19.702629 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-445e9102-340b-48a0-95fa-881f5c9a3c8e None admin] PATH_INFO: `/v3/services` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:07:19.702629 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-445e9102-340b-48a0-95fa-881f5c9a3c8e None admin] RBAC: Adding query filter params (type=compute) {{(pid=88550) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 19:07:19.702629 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-445e9102-340b-48a0-95fa-881f5c9a3c8e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:07:19.703961 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-445e9102-340b-48a0-95fa-881f5c9a3c8e None admin] RBAC: Authorization granted {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:07:19.708644 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: [pid: 88550|app: 0|req: 417/820] 10.222.0.26 () {56 vars in 1112 bytes} [Wed Aug 17 19:07:19 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 19:07:19.714516 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-421e23b6-df89-48f0-b5a6-038f94b3759e None admin] Authenticating user token {{(pid=88551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:07:19.812988 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-421e23b6-df89-48f0-b5a6-038f94b3759e None admin] Validating token access rules against request {{(pid=88551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:07:19.835772 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG dbcounter [-] [88551] Writing DB stats keystone:SELECT=100 {{(pid=88551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:07:19.846554 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc0bd384-3041-4229-b15a-4464aeb1962a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '819d41a279e64291acc60de51e1530ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:07:19.847155 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0bd384-3041-4229-b15a-4464aeb1962a None admin] REQUEST_METHOD: `POST` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:07:19.847435 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0bd384-3041-4229-b15a-4464aeb1962a None admin] SCRIPT_NAME: `/identity` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:07:19.847708 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0bd384-3041-4229-b15a-4464aeb1962a None admin] PATH_INFO: `/v3/endpoints` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:07:19.857061 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc0bd384-3041-4229-b15a-4464aeb1962a None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=88551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:07:19.857061 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc0bd384-3041-4229-b15a-4464aeb1962a None admin] RBAC: Authorization granted {{(pid=88551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:07:19.949457 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: [pid: 88551|app: 0|req: 404/821] 10.222.0.26 () {60 vars in 1144 bytes} [Wed Aug 17 19:07:19 2022] POST /identity/v3/endpoints => generated 334 bytes in 235 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 19:07:29.719517 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG dbcounter [-] [88550] Writing DB stats keystone:SELECT=5 {{(pid=88550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:07:29.944692 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG dbcounter [-] [88551] Writing DB stats keystone:SELECT=9,keystone:INSERT=1 {{(pid=88551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:08:39.015657 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d3daff7-1fe9-48e5-8df3-2b9e39a2cc6d None None] REQUEST_METHOD: `GET` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:08:39.016243 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d3daff7-1fe9-48e5-8df3-2b9e39a2cc6d None None] SCRIPT_NAME: `/identity` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:08:39.016243 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d3daff7-1fe9-48e5-8df3-2b9e39a2cc6d None None] PATH_INFO: `/` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:08:39.017550 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: [pid: 88550|app: 0|req: 418/822] 10.222.0.26 () {54 vars in 927 bytes} [Wed Aug 17 19:08:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 19:08:39.022899 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b63bbe29-8548-4370-8a4e-3737e045d236 None None] REQUEST_METHOD: `POST` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:08:39.023325 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b63bbe29-8548-4370-8a4e-3737e045d236 None None] SCRIPT_NAME: `/identity` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:08:39.023444 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b63bbe29-8548-4370-8a4e-3737e045d236 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:08:39.041703 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.auth.core [None req-b63bbe29-8548-4370-8a4e-3737e045d236 None None] MFA Rules not processed for user `819d41a279e64291acc60de51e1530ae`. Rule list: `[]` (Enabled: `True`). {{(pid=88551) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 19:08:39.042972 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.common.fernet_utils [None req-b63bbe29-8548-4370-8a4e-3737e045d236 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:08:39.115557 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: [pid: 88551|app: 0|req: 405/823] 10.222.0.26 () {58 vars in 1024 bytes} [Wed Aug 17 19:08:39 2022] POST /identity/v3/auth/tokens => generated 1869 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 17 19:08:39.441263 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d3daff7-1fe9-48e5-8df3-2b9e39a2cc6d None None] Authenticating user token {{(pid=88550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:08:39.547473 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d3daff7-1fe9-48e5-8df3-2b9e39a2cc6d None None] Validating token access rules against request {{(pid=88550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:08:39.580724 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0889139c-ed50-4ff6-aa45-1126b47ccf7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '819d41a279e64291acc60de51e1530ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:08:39.581345 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0889139c-ed50-4ff6-aa45-1126b47ccf7c None admin] REQUEST_METHOD: `GET` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:08:39.581621 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0889139c-ed50-4ff6-aa45-1126b47ccf7c None admin] SCRIPT_NAME: `/identity` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:08:39.581889 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0889139c-ed50-4ff6-aa45-1126b47ccf7c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:08:39.592367 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0889139c-ed50-4ff6-aa45-1126b47ccf7c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:08:39.593794 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0889139c-ed50-4ff6-aa45-1126b47ccf7c None admin] RBAC: Authorization granted {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:08:39.608471 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application [None req-0889139c-ed50-4ff6-aa45-1126b47ccf7c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 19:08:39.608471 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 19:08:39.608471 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 19:08:39.608471 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 19:08:39.608471 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 19:08:39.608471 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 19:08:39.608471 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 19:08:39.608471 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 19:08:39.608471 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 19:08:39.608471 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 19:08:39.608471 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 19:08:39.608471 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 19:08:39.608471 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 17 19:08:39.608471 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 17 19:08:39.608471 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 17 19:08:39.608471 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 17 19:08:39.609708 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 19:08:39.609708 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 19:08:39.609708 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 19:08:39.609708 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 19:08:39.609708 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 19:08:39.609708 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 19:08:39.609708 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 19:08:39.609708 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application with Lock( Aug 17 19:08:39.609708 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 19:08:39.609708 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return self._enter() Aug 17 19:08:39.609708 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 19:08:39.609708 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 19:08:39.609708 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 19:08:39.609708 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return self.creator() Aug 17 19:08:39.609708 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 19:08:39.609708 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application created_value = creator( Aug 17 19:08:39.609708 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 17 19:08:39.610829 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 17 19:08:39.610829 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 19:08:39.610829 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application Aug 17 19:08:39.610829 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: [pid: 88550|app: 0|req: 419/824] 10.222.0.26 () {56 vars in 1108 bytes} [Wed Aug 17 19:08:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 19:08:39.615765 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b63bbe29-8548-4370-8a4e-3737e045d236 None None] Authenticating user token {{(pid=88551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:08:39.715349 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b63bbe29-8548-4370-8a4e-3737e045d236 None None] Validating token access rules against request {{(pid=88551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:08:39.740824 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG dbcounter [-] [88551] Writing DB stats keystone:SELECT=100 {{(pid=88551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:08:39.749604 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73861dfa-766a-49cc-9e2e-125cfb37d86c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '819d41a279e64291acc60de51e1530ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:08:39.750254 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73861dfa-766a-49cc-9e2e-125cfb37d86c None admin] REQUEST_METHOD: `GET` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:08:39.750532 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73861dfa-766a-49cc-9e2e-125cfb37d86c None admin] SCRIPT_NAME: `/identity` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:08:39.750835 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73861dfa-766a-49cc-9e2e-125cfb37d86c None admin] PATH_INFO: `/v3/domains` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:08:39.751527 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73861dfa-766a-49cc-9e2e-125cfb37d86c None admin] RBAC: Adding query filter params (name=Default) {{(pid=88551) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 19:08:39.751834 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73861dfa-766a-49cc-9e2e-125cfb37d86c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:08:39.753291 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73861dfa-766a-49cc-9e2e-125cfb37d86c None admin] RBAC: Authorization granted {{(pid=88551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:08:39.764480 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: [pid: 88551|app: 0|req: 406/825] 10.222.0.26 () {56 vars in 1109 bytes} [Wed Aug 17 19:08:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 19:08:39.770163 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0889139c-ed50-4ff6-aa45-1126b47ccf7c None admin] Authenticating user token {{(pid=88550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:08:39.822949 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG dbcounter [-] [88550] Writing DB stats keystone:SELECT=100 {{(pid=88550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:08:39.871196 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0889139c-ed50-4ff6-aa45-1126b47ccf7c None admin] Validating token access rules against request {{(pid=88550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:08:39.904017 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c01ba05-21ef-434c-a6cc-91bc058b5f73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '819d41a279e64291acc60de51e1530ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:08:39.904616 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c01ba05-21ef-434c-a6cc-91bc058b5f73 None admin] REQUEST_METHOD: `POST` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:08:39.904900 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c01ba05-21ef-434c-a6cc-91bc058b5f73 None admin] SCRIPT_NAME: `/identity` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:08:39.905175 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c01ba05-21ef-434c-a6cc-91bc058b5f73 None admin] PATH_INFO: `/v3/users` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:08:39.905815 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c01ba05-21ef-434c-a6cc-91bc058b5f73 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:08:39.907281 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c01ba05-21ef-434c-a6cc-91bc058b5f73 None admin] RBAC: Authorization granted {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:08:40.027871 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: [pid: 88550|app: 0|req: 420/826] 10.222.0.26 () {60 vars in 1132 bytes} [Wed Aug 17 19:08:39 2022] POST /identity/v3/users => generated 251 bytes in 258 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 19:08:42.283083 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-710f1733-53ac-4e47-8a7e-d4a04c3c892a None None] REQUEST_METHOD: `GET` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:08:42.283653 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-710f1733-53ac-4e47-8a7e-d4a04c3c892a None None] SCRIPT_NAME: `/identity` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:08:42.283653 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-710f1733-53ac-4e47-8a7e-d4a04c3c892a None None] PATH_INFO: `/` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:08:42.285014 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: [pid: 88551|app: 0|req: 407/827] 10.222.0.26 () {54 vars in 927 bytes} [Wed Aug 17 19:08:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 19:08:42.290347 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e32170-8b51-4792-8b2b-4e58a155d518 None None] REQUEST_METHOD: `POST` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:08:42.290842 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e32170-8b51-4792-8b2b-4e58a155d518 None None] SCRIPT_NAME: `/identity` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:08:42.290957 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e32170-8b51-4792-8b2b-4e58a155d518 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:08:42.309620 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.auth.core [None req-c2e32170-8b51-4792-8b2b-4e58a155d518 None None] MFA Rules not processed for user `819d41a279e64291acc60de51e1530ae`. Rule list: `[]` (Enabled: `True`). {{(pid=88550) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 19:08:42.310859 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.common.fernet_utils [None req-c2e32170-8b51-4792-8b2b-4e58a155d518 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:08:42.381072 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: [pid: 88550|app: 0|req: 421/828] 10.222.0.26 () {58 vars in 1024 bytes} [Wed Aug 17 19:08:42 2022] POST /identity/v3/auth/tokens => generated 1869 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 17 19:08:42.715324 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-710f1733-53ac-4e47-8a7e-d4a04c3c892a None None] Authenticating user token {{(pid=88551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:08:42.824431 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-710f1733-53ac-4e47-8a7e-d4a04c3c892a None None] Validating token access rules against request {{(pid=88551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:08:42.861380 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7302b354-a50e-45bf-97ca-c9ed7273afcf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '819d41a279e64291acc60de51e1530ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:08:42.862013 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7302b354-a50e-45bf-97ca-c9ed7273afcf None admin] REQUEST_METHOD: `GET` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:08:42.862288 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7302b354-a50e-45bf-97ca-c9ed7273afcf None admin] SCRIPT_NAME: `/identity` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:08:42.862586 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7302b354-a50e-45bf-97ca-c9ed7273afcf None admin] PATH_INFO: `/v3/roles/service` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:08:42.874738 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7302b354-a50e-45bf-97ca-c9ed7273afcf None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 17 19:08:42.879624 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application [None req-7302b354-a50e-45bf-97ca-c9ed7273afcf None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 17 19:08:42.879624 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 19:08:42.879624 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 19:08:42.879624 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 19:08:42.879624 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 19:08:42.879624 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 19:08:42.879624 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 19:08:42.879624 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 19:08:42.879624 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 19:08:42.879624 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 19:08:42.879624 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 19:08:42.879624 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 19:08:42.879624 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 17 19:08:42.879624 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 17 19:08:42.879624 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 17 19:08:42.879624 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 17 19:08:42.880788 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 17 19:08:42.880788 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 17 19:08:42.880788 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 17 19:08:42.880788 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 17 19:08:42.880788 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 19:08:42.880788 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 19:08:42.880788 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 19:08:42.880788 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 19:08:42.880788 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 19:08:42.880788 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 19:08:42.880788 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 19:08:42.880788 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application with Lock( Aug 17 19:08:42.880788 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 19:08:42.880788 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application return self._enter() Aug 17 19:08:42.880788 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 19:08:42.880788 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 19:08:42.881750 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 19:08:42.881750 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application return self.creator() Aug 17 19:08:42.881750 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 19:08:42.881750 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application created_value = creator( Aug 17 19:08:42.881750 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 17 19:08:42.881750 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 17 19:08:42.881750 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 17 19:08:42.881750 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 17 19:08:42.881750 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 17 19:08:42.881750 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 17 19:08:42.881750 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 17 19:08:42.881750 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application Aug 17 19:08:42.881750 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: [pid: 88551|app: 0|req: 408/829] 10.222.0.26 () {56 vars in 1102 bytes} [Wed Aug 17 19:08:42 2022] GET /identity/v3/roles/service => generated 85 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 19:08:42.887077 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2e32170-8b51-4792-8b2b-4e58a155d518 None None] Authenticating user token {{(pid=88550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:08:42.926408 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG dbcounter [-] [88550] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:08:42.989220 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2e32170-8b51-4792-8b2b-4e58a155d518 None None] Validating token access rules against request {{(pid=88550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:08:43.023465 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29a3b337-fffd-48ec-a2d9-b29593be7538 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '819d41a279e64291acc60de51e1530ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:08:43.024067 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a3b337-fffd-48ec-a2d9-b29593be7538 None admin] REQUEST_METHOD: `GET` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:08:43.024391 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a3b337-fffd-48ec-a2d9-b29593be7538 None admin] SCRIPT_NAME: `/identity` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:08:43.024649 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a3b337-fffd-48ec-a2d9-b29593be7538 None admin] PATH_INFO: `/v3/roles` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:08:43.025319 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29a3b337-fffd-48ec-a2d9-b29593be7538 None admin] RBAC: Adding query filter params (name=service) {{(pid=88550) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 19:08:43.025645 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29a3b337-fffd-48ec-a2d9-b29593be7538 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:08:43.027575 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29a3b337-fffd-48ec-a2d9-b29593be7538 None admin] RBAC: Authorization granted {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:08:43.035815 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: [pid: 88550|app: 0|req: 422/830] 10.222.0.26 () {56 vars in 1103 bytes} [Wed Aug 17 19:08:42 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 19:08:43.041655 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7302b354-a50e-45bf-97ca-c9ed7273afcf None admin] Authenticating user token {{(pid=88551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:08:43.092263 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG dbcounter [-] [88551] Writing DB stats keystone:SELECT=100 {{(pid=88551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:08:43.145465 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7302b354-a50e-45bf-97ca-c9ed7273afcf None admin] Validating token access rules against request {{(pid=88551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:08:43.180543 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1279cbd2-f412-40f5-956c-60632fc4f586 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '819d41a279e64291acc60de51e1530ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:08:43.181155 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1279cbd2-f412-40f5-956c-60632fc4f586 None admin] REQUEST_METHOD: `GET` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:08:43.181431 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1279cbd2-f412-40f5-956c-60632fc4f586 None admin] SCRIPT_NAME: `/identity` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:08:43.181698 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1279cbd2-f412-40f5-956c-60632fc4f586 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:08:43.192636 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1279cbd2-f412-40f5-956c-60632fc4f586 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:08:43.194048 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1279cbd2-f412-40f5-956c-60632fc4f586 None admin] RBAC: Authorization granted {{(pid=88551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:08:43.207573 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application [None req-1279cbd2-f412-40f5-956c-60632fc4f586 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 19:08:43.207573 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 19:08:43.207573 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 19:08:43.207573 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 19:08:43.207573 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 19:08:43.207573 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 19:08:43.207573 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 19:08:43.207573 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 19:08:43.207573 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 19:08:43.207573 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 19:08:43.207573 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 19:08:43.207573 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 19:08:43.207573 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 17 19:08:43.207573 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 17 19:08:43.207573 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 17 19:08:43.207573 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 17 19:08:43.212727 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 19:08:43.212727 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 19:08:43.212727 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 19:08:43.212727 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 19:08:43.212727 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 19:08:43.212727 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 19:08:43.212727 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 19:08:43.212727 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application with Lock( Aug 17 19:08:43.212727 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 19:08:43.212727 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application return self._enter() Aug 17 19:08:43.212727 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 19:08:43.212727 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 19:08:43.212727 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 19:08:43.212727 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application return self.creator() Aug 17 19:08:43.212727 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 19:08:43.212727 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application created_value = creator( Aug 17 19:08:43.212727 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 17 19:08:43.214281 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 17 19:08:43.214281 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 19:08:43.214281 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application Aug 17 19:08:43.214281 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: [pid: 88551|app: 0|req: 409/831] 10.222.0.26 () {56 vars in 1108 bytes} [Wed Aug 17 19:08:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 19:08:43.215109 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29a3b337-fffd-48ec-a2d9-b29593be7538 None admin] Authenticating user token {{(pid=88550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:08:43.314930 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG dbcounter [-] [88550] Writing DB stats keystone:SELECT=100 {{(pid=88550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:08:43.315693 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29a3b337-fffd-48ec-a2d9-b29593be7538 None admin] Validating token access rules against request {{(pid=88550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:08:43.350152 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0ca0e07-761e-42b0-91a5-907e745e4151 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '819d41a279e64291acc60de51e1530ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:08:43.350781 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ca0e07-761e-42b0-91a5-907e745e4151 None admin] REQUEST_METHOD: `GET` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:08:43.351062 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ca0e07-761e-42b0-91a5-907e745e4151 None admin] SCRIPT_NAME: `/identity` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:08:43.351332 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ca0e07-761e-42b0-91a5-907e745e4151 None admin] PATH_INFO: `/v3/domains` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:08:43.351973 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0ca0e07-761e-42b0-91a5-907e745e4151 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88550) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 19:08:43.352272 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0ca0e07-761e-42b0-91a5-907e745e4151 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:08:43.353622 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0ca0e07-761e-42b0-91a5-907e745e4151 None admin] RBAC: Authorization granted {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:08:43.366221 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: [pid: 88550|app: 0|req: 423/832] 10.222.0.26 () {56 vars in 1109 bytes} [Wed Aug 17 19:08:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 19:08:43.372121 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1279cbd2-f412-40f5-956c-60632fc4f586 None admin] Authenticating user token {{(pid=88551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:08:43.473075 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG dbcounter [-] [88551] Writing DB stats keystone:SELECT=100 {{(pid=88551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:08:43.477206 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1279cbd2-f412-40f5-956c-60632fc4f586 None admin] Validating token access rules against request {{(pid=88551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:08:43.512748 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbad8e69-9d51-49d0-8428-26b79f7658ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '819d41a279e64291acc60de51e1530ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:08:43.513371 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbad8e69-9d51-49d0-8428-26b79f7658ad None admin] REQUEST_METHOD: `GET` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:08:43.513650 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbad8e69-9d51-49d0-8428-26b79f7658ad None admin] SCRIPT_NAME: `/identity` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:08:43.513920 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbad8e69-9d51-49d0-8428-26b79f7658ad None admin] PATH_INFO: `/v3/users/placement` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:08:43.522284 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbad8e69-9d51-49d0-8428-26b79f7658ad None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=88551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:08:43.526179 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbad8e69-9d51-49d0-8428-26b79f7658ad None admin] RBAC: Authorization granted {{(pid=88551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:08:43.536276 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application [None req-bbad8e69-9d51-49d0-8428-26b79f7658ad None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 17 19:08:43.536276 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 19:08:43.536276 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 19:08:43.536276 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 19:08:43.536276 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 19:08:43.536276 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 19:08:43.536276 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 19:08:43.536276 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 19:08:43.536276 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 19:08:43.536276 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 19:08:43.536276 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 19:08:43.536276 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 19:08:43.536276 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 17 19:08:43.536276 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 17 19:08:43.536276 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 17 19:08:43.536276 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 17 19:08:43.537327 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 19:08:43.537327 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 19:08:43.537327 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 17 19:08:43.537327 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 17 19:08:43.537327 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 17 19:08:43.537327 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 17 19:08:43.537327 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 19:08:43.537327 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 19:08:43.537327 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 19:08:43.537327 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 19:08:43.537327 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 19:08:43.537327 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application with Lock( Aug 17 19:08:43.537327 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 19:08:43.537327 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application return self._enter() Aug 17 19:08:43.537327 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 19:08:43.537327 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 19:08:43.537327 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 19:08:43.537327 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application return self.creator() Aug 17 19:08:43.538308 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 19:08:43.538308 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application created_value = creator( Aug 17 19:08:43.538308 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 17 19:08:43.538308 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 17 19:08:43.538308 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 17 19:08:43.538308 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 17 19:08:43.538308 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 17 19:08:43.538308 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 17 19:08:43.538308 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 17 19:08:43.538308 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application Aug 17 19:08:43.538308 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: [pid: 88551|app: 0|req: 410/833] 10.222.0.26 () {56 vars in 1108 bytes} [Wed Aug 17 19:08:43 2022] GET /identity/v3/users/placement => generated 87 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 19:08:43.543318 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0ca0e07-761e-42b0-91a5-907e745e4151 None admin] Authenticating user token {{(pid=88550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:08:43.644756 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0ca0e07-761e-42b0-91a5-907e745e4151 None admin] Validating token access rules against request {{(pid=88550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:08:43.679011 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26e1af06-a5c4-418c-8ec1-e700ab6b9b63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '819d41a279e64291acc60de51e1530ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:08:43.679614 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e1af06-a5c4-418c-8ec1-e700ab6b9b63 None admin] REQUEST_METHOD: `GET` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:08:43.679897 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e1af06-a5c4-418c-8ec1-e700ab6b9b63 None admin] SCRIPT_NAME: `/identity` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:08:43.680171 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e1af06-a5c4-418c-8ec1-e700ab6b9b63 None admin] PATH_INFO: `/v3/users` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:08:43.680895 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26e1af06-a5c4-418c-8ec1-e700ab6b9b63 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=88550) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 19:08:43.681267 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26e1af06-a5c4-418c-8ec1-e700ab6b9b63 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:08:43.682754 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26e1af06-a5c4-418c-8ec1-e700ab6b9b63 None admin] RBAC: Authorization granted {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:08:43.700721 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: [pid: 88550|app: 0|req: 424/834] 10.222.0.26 () {56 vars in 1143 bytes} [Wed Aug 17 19:08:43 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 19:08:43.706638 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbad8e69-9d51-49d0-8428-26b79f7658ad None admin] Authenticating user token {{(pid=88551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:08:43.808749 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbad8e69-9d51-49d0-8428-26b79f7658ad None admin] Validating token access rules against request {{(pid=88551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:08:43.843647 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea5f6f0a-6867-477b-81ed-0c01879edde3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '819d41a279e64291acc60de51e1530ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:08:43.844252 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea5f6f0a-6867-477b-81ed-0c01879edde3 None admin] REQUEST_METHOD: `GET` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:08:43.844529 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea5f6f0a-6867-477b-81ed-0c01879edde3 None admin] SCRIPT_NAME: `/identity` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:08:43.844804 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea5f6f0a-6867-477b-81ed-0c01879edde3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:08:43.874005 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG dbcounter [-] [88551] Writing DB stats keystone:SELECT=100 {{(pid=88551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:08:43.915337 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea5f6f0a-6867-477b-81ed-0c01879edde3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:08:43.916742 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea5f6f0a-6867-477b-81ed-0c01879edde3 None admin] RBAC: Authorization granted {{(pid=88551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:08:44.019030 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: [pid: 88551|app: 0|req: 411/835] 10.222.0.26 () {58 vars in 1282 bytes} [Wed Aug 17 19:08:43 2022] GET /identity/v3/auth/tokens => generated 1869 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 17 19:08:44.024814 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26e1af06-a5c4-418c-8ec1-e700ab6b9b63 None admin] Authenticating user token {{(pid=88550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:08:44.044064 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG dbcounter [-] [88550] Writing DB stats keystone:SELECT=100 {{(pid=88550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:08:44.124467 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26e1af06-a5c4-418c-8ec1-e700ab6b9b63 None admin] Validating token access rules against request {{(pid=88550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:08:44.161506 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-036f348e-5165-4aa4-8471-225f5d98fce9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '819d41a279e64291acc60de51e1530ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:08:44.162147 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-036f348e-5165-4aa4-8471-225f5d98fce9 None admin] REQUEST_METHOD: `GET` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:08:44.162427 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-036f348e-5165-4aa4-8471-225f5d98fce9 None admin] SCRIPT_NAME: `/identity` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:08:44.162758 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-036f348e-5165-4aa4-8471-225f5d98fce9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:08:44.174195 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-036f348e-5165-4aa4-8471-225f5d98fce9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:08:44.175619 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-036f348e-5165-4aa4-8471-225f5d98fce9 None admin] RBAC: Authorization granted {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:08:44.191247 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application [None req-036f348e-5165-4aa4-8471-225f5d98fce9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 19:08:44.191247 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 19:08:44.191247 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 19:08:44.191247 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 19:08:44.191247 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 19:08:44.191247 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 19:08:44.191247 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 19:08:44.191247 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 19:08:44.191247 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 19:08:44.191247 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 19:08:44.191247 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 19:08:44.191247 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 19:08:44.191247 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 17 19:08:44.191247 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 17 19:08:44.191247 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 17 19:08:44.191247 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 17 19:08:44.192455 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 19:08:44.192455 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 19:08:44.192455 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 19:08:44.192455 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 19:08:44.192455 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 19:08:44.192455 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 19:08:44.192455 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 19:08:44.192455 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application with Lock( Aug 17 19:08:44.192455 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 19:08:44.192455 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return self._enter() Aug 17 19:08:44.192455 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 19:08:44.192455 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 19:08:44.192455 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 19:08:44.192455 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return self.creator() Aug 17 19:08:44.192455 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 19:08:44.192455 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application created_value = creator( Aug 17 19:08:44.192455 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 17 19:08:44.193770 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 17 19:08:44.193770 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 19:08:44.193770 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application Aug 17 19:08:44.193770 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: [pid: 88550|app: 0|req: 425/836] 10.222.0.26 () {56 vars in 1108 bytes} [Wed Aug 17 19:08:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 19:08:44.198251 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea5f6f0a-6867-477b-81ed-0c01879edde3 None admin] Authenticating user token {{(pid=88551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:08:44.259487 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG dbcounter [-] [88551] Writing DB stats keystone:SELECT=100 {{(pid=88551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:08:44.300815 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea5f6f0a-6867-477b-81ed-0c01879edde3 None admin] Validating token access rules against request {{(pid=88551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:08:44.335217 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7102bc3-9731-40b9-b8f2-0e26ba4249b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '819d41a279e64291acc60de51e1530ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:08:44.335818 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7102bc3-9731-40b9-b8f2-0e26ba4249b2 None admin] REQUEST_METHOD: `GET` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:08:44.336097 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7102bc3-9731-40b9-b8f2-0e26ba4249b2 None admin] SCRIPT_NAME: `/identity` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:08:44.336368 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7102bc3-9731-40b9-b8f2-0e26ba4249b2 None admin] PATH_INFO: `/v3/domains` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:08:44.337049 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7102bc3-9731-40b9-b8f2-0e26ba4249b2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88551) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 19:08:44.337389 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7102bc3-9731-40b9-b8f2-0e26ba4249b2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:08:44.338809 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7102bc3-9731-40b9-b8f2-0e26ba4249b2 None admin] RBAC: Authorization granted {{(pid=88551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:08:44.351379 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: [pid: 88551|app: 0|req: 412/837] 10.222.0.26 () {56 vars in 1109 bytes} [Wed Aug 17 19:08:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 19:08:44.357734 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-036f348e-5165-4aa4-8471-225f5d98fce9 None admin] Authenticating user token {{(pid=88550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:08:44.427538 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG dbcounter [-] [88550] Writing DB stats keystone:SELECT=100 {{(pid=88550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:08:44.458184 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-036f348e-5165-4aa4-8471-225f5d98fce9 None admin] Validating token access rules against request {{(pid=88550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:08:44.492988 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7772e8a5-4dd7-489a-bae4-61f72dcbab14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '819d41a279e64291acc60de51e1530ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:08:44.493619 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7772e8a5-4dd7-489a-bae4-61f72dcbab14 None admin] REQUEST_METHOD: `GET` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:08:44.493901 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7772e8a5-4dd7-489a-bae4-61f72dcbab14 None admin] SCRIPT_NAME: `/identity` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:08:44.494177 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7772e8a5-4dd7-489a-bae4-61f72dcbab14 None admin] PATH_INFO: `/v3/projects/service` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:08:44.501310 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7772e8a5-4dd7-489a-bae4-61f72dcbab14 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:08:44.502779 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7772e8a5-4dd7-489a-bae4-61f72dcbab14 None admin] RBAC: Authorization granted {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:08:44.513943 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application [None req-7772e8a5-4dd7-489a-bae4-61f72dcbab14 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 17 19:08:44.513943 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 19:08:44.513943 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 19:08:44.513943 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 19:08:44.513943 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 19:08:44.513943 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 19:08:44.513943 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 19:08:44.513943 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 19:08:44.513943 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 19:08:44.513943 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 19:08:44.513943 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 19:08:44.513943 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 19:08:44.513943 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 17 19:08:44.513943 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 17 19:08:44.513943 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 17 19:08:44.520313 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 17 19:08:44.520313 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 19:08:44.520313 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 19:08:44.520313 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 19:08:44.520313 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 19:08:44.520313 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 19:08:44.520313 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 19:08:44.520313 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 19:08:44.520313 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application with Lock( Aug 17 19:08:44.520313 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 19:08:44.520313 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return self._enter() Aug 17 19:08:44.520313 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 19:08:44.520313 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 19:08:44.520313 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 19:08:44.520313 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return self.creator() Aug 17 19:08:44.520313 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 19:08:44.520313 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application created_value = creator( Aug 17 19:08:44.521451 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 17 19:08:44.521451 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 17 19:08:44.521451 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 17 19:08:44.521451 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 17 19:08:44.521451 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 17 19:08:44.521451 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 17 19:08:44.521451 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 17 19:08:44.521451 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application Aug 17 19:08:44.521451 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: [pid: 88550|app: 0|req: 426/838] 10.222.0.26 () {56 vars in 1111 bytes} [Wed Aug 17 19:08:44 2022] GET /identity/v3/projects/service => generated 88 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 17 19:08:44.522125 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7102bc3-9731-40b9-b8f2-0e26ba4249b2 None admin] Authenticating user token {{(pid=88551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:08:44.622801 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7102bc3-9731-40b9-b8f2-0e26ba4249b2 None admin] Validating token access rules against request {{(pid=88551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:08:44.640110 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG dbcounter [-] [88551] Writing DB stats keystone:SELECT=100 {{(pid=88551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:08:44.664535 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20e9489d-b3ca-453a-bf9b-35fbbcb10c35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '819d41a279e64291acc60de51e1530ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:08:44.665134 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e9489d-b3ca-453a-bf9b-35fbbcb10c35 None admin] REQUEST_METHOD: `GET` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:08:44.665413 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e9489d-b3ca-453a-bf9b-35fbbcb10c35 None admin] SCRIPT_NAME: `/identity` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:08:44.665687 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e9489d-b3ca-453a-bf9b-35fbbcb10c35 None admin] PATH_INFO: `/v3/projects` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:08:44.666430 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20e9489d-b3ca-453a-bf9b-35fbbcb10c35 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88551) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 19:08:44.667428 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20e9489d-b3ca-453a-bf9b-35fbbcb10c35 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:08:44.668848 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20e9489d-b3ca-453a-bf9b-35fbbcb10c35 None admin] RBAC: Authorization granted {{(pid=88551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:08:44.682505 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: [pid: 88551|app: 0|req: 413/839] 10.222.0.26 () {56 vars in 1148 bytes} [Wed Aug 17 19:08:44 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 19:08:44.686926 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7772e8a5-4dd7-489a-bae4-61f72dcbab14 None admin] Authenticating user token {{(pid=88550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:08:44.788651 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7772e8a5-4dd7-489a-bae4-61f72dcbab14 None admin] Validating token access rules against request {{(pid=88550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:08:44.819082 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG dbcounter [-] [88550] Writing DB stats keystone:SELECT=100 {{(pid=88550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:08:44.824933 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53be9bcd-bba6-4f9f-8efe-b43438a67a94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '819d41a279e64291acc60de51e1530ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:08:44.825532 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53be9bcd-bba6-4f9f-8efe-b43438a67a94 None admin] REQUEST_METHOD: `GET` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:08:44.825825 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53be9bcd-bba6-4f9f-8efe-b43438a67a94 None admin] SCRIPT_NAME: `/identity` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:08:44.826129 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53be9bcd-bba6-4f9f-8efe-b43438a67a94 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:08:44.826889 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53be9bcd-bba6-4f9f-8efe-b43438a67a94 None admin] RBAC: Adding query filter params (role.id=c798e3cf305b42dc8579aac6f3229a4b, scope.project.id=4bbf6c5abd684d899d09a08b0847d81c, user.id=6478a47e33024d1abc99f078dbc30787) {{(pid=88550) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 19:08:44.827199 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53be9bcd-bba6-4f9f-8efe-b43438a67a94 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:08:44.828630 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53be9bcd-bba6-4f9f-8efe-b43438a67a94 None admin] RBAC: Authorization granted {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:08:44.834145 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: [pid: 88550|app: 0|req: 427/840] 10.222.0.26 () {56 vars in 1374 bytes} [Wed Aug 17 19:08:44 2022] GET /identity/v3/role_assignments?user.id=6478a47e33024d1abc99f078dbc30787&scope.project.id=4bbf6c5abd684d899d09a08b0847d81c&role.id=c798e3cf305b42dc8579aac6f3229a4b => generated 259 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 19:08:47.014918 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e763047-f6ac-4a2f-bb0c-ae3bd59b5fa4 None None] REQUEST_METHOD: `GET` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:08:47.015458 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e763047-f6ac-4a2f-bb0c-ae3bd59b5fa4 None None] SCRIPT_NAME: `/identity` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:08:47.015458 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e763047-f6ac-4a2f-bb0c-ae3bd59b5fa4 None None] PATH_INFO: `/` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:08:47.016902 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: [pid: 88551|app: 0|req: 414/841] 10.222.0.26 () {54 vars in 927 bytes} [Wed Aug 17 19:08:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 19:08:47.022217 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4cc9f1f-67c7-4247-b6cd-eefcc104adc2 None None] REQUEST_METHOD: `POST` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:08:47.022652 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4cc9f1f-67c7-4247-b6cd-eefcc104adc2 None None] SCRIPT_NAME: `/identity` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:08:47.022800 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4cc9f1f-67c7-4247-b6cd-eefcc104adc2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:08:47.041378 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.auth.core [None req-e4cc9f1f-67c7-4247-b6cd-eefcc104adc2 None None] MFA Rules not processed for user `819d41a279e64291acc60de51e1530ae`. Rule list: `[]` (Enabled: `True`). {{(pid=88550) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 19:08:47.043295 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.common.fernet_utils [None req-e4cc9f1f-67c7-4247-b6cd-eefcc104adc2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:08:47.112954 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: [pid: 88550|app: 0|req: 428/842] 10.222.0.26 () {58 vars in 1024 bytes} [Wed Aug 17 19:08:47 2022] POST /identity/v3/auth/tokens => generated 1869 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 17 19:08:47.443387 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e763047-f6ac-4a2f-bb0c-ae3bd59b5fa4 None None] Authenticating user token {{(pid=88551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:08:47.544094 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e763047-f6ac-4a2f-bb0c-ae3bd59b5fa4 None None] Validating token access rules against request {{(pid=88551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:08:47.577728 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df734607-5ad1-4831-bca5-3517ec10e81a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '819d41a279e64291acc60de51e1530ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:08:47.578337 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df734607-5ad1-4831-bca5-3517ec10e81a None admin] REQUEST_METHOD: `GET` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:08:47.578640 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df734607-5ad1-4831-bca5-3517ec10e81a None admin] SCRIPT_NAME: `/identity` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:08:47.578927 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df734607-5ad1-4831-bca5-3517ec10e81a None admin] PATH_INFO: `/v3/roles/service` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:08:47.589843 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df734607-5ad1-4831-bca5-3517ec10e81a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 17 19:08:47.594732 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application [None req-df734607-5ad1-4831-bca5-3517ec10e81a None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 17 19:08:47.594732 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 19:08:47.594732 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 19:08:47.594732 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 19:08:47.594732 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 19:08:47.594732 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 19:08:47.594732 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 19:08:47.594732 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 19:08:47.594732 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 19:08:47.594732 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 19:08:47.594732 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 19:08:47.594732 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 19:08:47.594732 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 17 19:08:47.594732 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 17 19:08:47.594732 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 17 19:08:47.594732 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 17 19:08:47.595872 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 17 19:08:47.595872 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 17 19:08:47.595872 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 17 19:08:47.595872 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 17 19:08:47.595872 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 19:08:47.595872 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 19:08:47.595872 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 19:08:47.595872 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 19:08:47.595872 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 19:08:47.595872 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 19:08:47.595872 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 19:08:47.595872 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application with Lock( Aug 17 19:08:47.595872 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 19:08:47.595872 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application return self._enter() Aug 17 19:08:47.595872 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 19:08:47.595872 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 19:08:47.596922 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 19:08:47.596922 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application return self.creator() Aug 17 19:08:47.596922 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 19:08:47.596922 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application created_value = creator( Aug 17 19:08:47.596922 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 17 19:08:47.596922 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 17 19:08:47.596922 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 17 19:08:47.596922 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 17 19:08:47.596922 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 17 19:08:47.596922 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 17 19:08:47.596922 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 17 19:08:47.596922 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application Aug 17 19:08:47.596922 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: [pid: 88551|app: 0|req: 415/843] 10.222.0.26 () {56 vars in 1102 bytes} [Wed Aug 17 19:08:47 2022] GET /identity/v3/roles/service => generated 85 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 19:08:47.602104 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4cc9f1f-67c7-4247-b6cd-eefcc104adc2 None None] Authenticating user token {{(pid=88550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:08:47.701553 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4cc9f1f-67c7-4247-b6cd-eefcc104adc2 None None] Validating token access rules against request {{(pid=88550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:08:47.724577 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG dbcounter [-] [88550] Writing DB stats keystone:SELECT=100 {{(pid=88550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:08:47.735964 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7516002-c406-4765-b6af-b132d40dc35a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '819d41a279e64291acc60de51e1530ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:08:47.736564 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7516002-c406-4765-b6af-b132d40dc35a None admin] REQUEST_METHOD: `GET` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:08:47.736846 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7516002-c406-4765-b6af-b132d40dc35a None admin] SCRIPT_NAME: `/identity` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:08:47.737121 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7516002-c406-4765-b6af-b132d40dc35a None admin] PATH_INFO: `/v3/roles` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:08:47.737811 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7516002-c406-4765-b6af-b132d40dc35a None admin] RBAC: Adding query filter params (name=service) {{(pid=88550) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 19:08:47.738114 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7516002-c406-4765-b6af-b132d40dc35a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:08:47.739511 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7516002-c406-4765-b6af-b132d40dc35a None admin] RBAC: Authorization granted {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:08:47.747728 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: [pid: 88550|app: 0|req: 429/844] 10.222.0.26 () {56 vars in 1103 bytes} [Wed Aug 17 19:08:47 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 19:08:47.753520 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df734607-5ad1-4831-bca5-3517ec10e81a None admin] Authenticating user token {{(pid=88551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:08:47.796090 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG dbcounter [-] [88551] Writing DB stats keystone:SELECT=100 {{(pid=88551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:08:47.859630 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df734607-5ad1-4831-bca5-3517ec10e81a None admin] Validating token access rules against request {{(pid=88551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:08:47.897560 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af08e2da-3b91-4a23-9ef5-6eeb7e55c13b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '819d41a279e64291acc60de51e1530ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:08:47.898170 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af08e2da-3b91-4a23-9ef5-6eeb7e55c13b None admin] REQUEST_METHOD: `GET` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:08:47.898451 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af08e2da-3b91-4a23-9ef5-6eeb7e55c13b None admin] SCRIPT_NAME: `/identity` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:08:47.898751 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af08e2da-3b91-4a23-9ef5-6eeb7e55c13b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:08:47.909083 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af08e2da-3b91-4a23-9ef5-6eeb7e55c13b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:08:47.910530 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af08e2da-3b91-4a23-9ef5-6eeb7e55c13b None admin] RBAC: Authorization granted {{(pid=88551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:08:47.925682 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application [None req-af08e2da-3b91-4a23-9ef5-6eeb7e55c13b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 19:08:47.925682 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 19:08:47.925682 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 19:08:47.925682 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 19:08:47.925682 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 19:08:47.925682 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 19:08:47.925682 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 19:08:47.925682 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 19:08:47.925682 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 19:08:47.925682 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 19:08:47.925682 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 19:08:47.925682 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 19:08:47.925682 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 17 19:08:47.925682 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 17 19:08:47.925682 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 17 19:08:47.925682 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 17 19:08:47.926878 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 19:08:47.926878 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 19:08:47.926878 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 19:08:47.926878 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 19:08:47.926878 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 19:08:47.926878 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 19:08:47.926878 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 19:08:47.926878 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application with Lock( Aug 17 19:08:47.926878 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 19:08:47.926878 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application return self._enter() Aug 17 19:08:47.926878 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 19:08:47.926878 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 19:08:47.926878 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 19:08:47.926878 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application return self.creator() Aug 17 19:08:47.926878 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 19:08:47.926878 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application created_value = creator( Aug 17 19:08:47.926878 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 17 19:08:47.927863 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 17 19:08:47.927863 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 19:08:47.927863 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application Aug 17 19:08:47.927863 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: [pid: 88551|app: 0|req: 416/845] 10.222.0.26 () {56 vars in 1108 bytes} [Wed Aug 17 19:08:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 19:08:47.933290 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7516002-c406-4765-b6af-b132d40dc35a None admin] Authenticating user token {{(pid=88550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:08:48.043917 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7516002-c406-4765-b6af-b132d40dc35a None admin] Validating token access rules against request {{(pid=88550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:08:48.077707 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5f96ff5-139e-4fd5-b3b7-fb3a2eb82efd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '819d41a279e64291acc60de51e1530ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:08:48.078305 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f96ff5-139e-4fd5-b3b7-fb3a2eb82efd None admin] REQUEST_METHOD: `GET` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:08:48.078626 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f96ff5-139e-4fd5-b3b7-fb3a2eb82efd None admin] SCRIPT_NAME: `/identity` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:08:48.078905 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f96ff5-139e-4fd5-b3b7-fb3a2eb82efd None admin] PATH_INFO: `/v3/domains` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:08:48.079548 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5f96ff5-139e-4fd5-b3b7-fb3a2eb82efd None admin] RBAC: Adding query filter params (name=Default) {{(pid=88550) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 19:08:48.079853 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5f96ff5-139e-4fd5-b3b7-fb3a2eb82efd None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:08:48.081214 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5f96ff5-139e-4fd5-b3b7-fb3a2eb82efd None admin] RBAC: Authorization granted {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:08:48.092828 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: [pid: 88550|app: 0|req: 430/846] 10.222.0.26 () {56 vars in 1109 bytes} [Wed Aug 17 19:08:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 19:08:48.099219 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af08e2da-3b91-4a23-9ef5-6eeb7e55c13b None admin] Authenticating user token {{(pid=88551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:08:48.196230 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG dbcounter [-] [88551] Writing DB stats keystone:SELECT=100 {{(pid=88551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:08:48.205766 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af08e2da-3b91-4a23-9ef5-6eeb7e55c13b None admin] Validating token access rules against request {{(pid=88551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:08:48.240066 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38b5ef1a-8856-421c-a337-3e63c08f115c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '819d41a279e64291acc60de51e1530ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:08:48.240682 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b5ef1a-8856-421c-a337-3e63c08f115c None admin] REQUEST_METHOD: `GET` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:08:48.240956 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b5ef1a-8856-421c-a337-3e63c08f115c None admin] SCRIPT_NAME: `/identity` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:08:48.241224 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b5ef1a-8856-421c-a337-3e63c08f115c None admin] PATH_INFO: `/v3/users/placement` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:08:48.248326 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38b5ef1a-8856-421c-a337-3e63c08f115c None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=88551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:08:48.249775 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38b5ef1a-8856-421c-a337-3e63c08f115c None admin] RBAC: Authorization granted {{(pid=88551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:08:48.262128 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application [None req-38b5ef1a-8856-421c-a337-3e63c08f115c None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 17 19:08:48.262128 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 19:08:48.262128 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 19:08:48.262128 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 19:08:48.262128 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 19:08:48.262128 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 19:08:48.262128 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 19:08:48.262128 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 19:08:48.262128 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 19:08:48.262128 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 19:08:48.262128 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 19:08:48.262128 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 19:08:48.262128 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 17 19:08:48.262128 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 17 19:08:48.262128 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 17 19:08:48.262128 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 17 19:08:48.263495 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 19:08:48.263495 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 19:08:48.263495 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 17 19:08:48.263495 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 17 19:08:48.263495 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 17 19:08:48.263495 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 17 19:08:48.263495 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 19:08:48.263495 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 19:08:48.263495 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 19:08:48.263495 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 19:08:48.263495 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 19:08:48.263495 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application with Lock( Aug 17 19:08:48.263495 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 19:08:48.263495 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application return self._enter() Aug 17 19:08:48.263495 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 19:08:48.263495 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 19:08:48.263495 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 19:08:48.263495 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application return self.creator() Aug 17 19:08:48.264950 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 19:08:48.264950 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application created_value = creator( Aug 17 19:08:48.264950 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 17 19:08:48.264950 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 17 19:08:48.264950 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 17 19:08:48.264950 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 17 19:08:48.264950 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 17 19:08:48.264950 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 17 19:08:48.264950 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 17 19:08:48.264950 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application Aug 17 19:08:48.264950 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: [pid: 88551|app: 0|req: 417/847] 10.222.0.26 () {56 vars in 1108 bytes} [Wed Aug 17 19:08:48 2022] GET /identity/v3/users/placement => generated 87 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 19:08:48.269886 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5f96ff5-139e-4fd5-b3b7-fb3a2eb82efd None admin] Authenticating user token {{(pid=88550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:08:48.318135 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG dbcounter [-] [88550] Writing DB stats keystone:SELECT=100 {{(pid=88550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:08:48.370948 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5f96ff5-139e-4fd5-b3b7-fb3a2eb82efd None admin] Validating token access rules against request {{(pid=88550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:08:48.405487 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edd99f01-9ac0-4577-9371-8e2bf4e07c71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '819d41a279e64291acc60de51e1530ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:08:48.406099 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd99f01-9ac0-4577-9371-8e2bf4e07c71 None admin] REQUEST_METHOD: `GET` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:08:48.406380 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd99f01-9ac0-4577-9371-8e2bf4e07c71 None admin] SCRIPT_NAME: `/identity` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:08:48.406690 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd99f01-9ac0-4577-9371-8e2bf4e07c71 None admin] PATH_INFO: `/v3/users` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:08:48.407430 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edd99f01-9ac0-4577-9371-8e2bf4e07c71 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=88550) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 19:08:48.407735 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edd99f01-9ac0-4577-9371-8e2bf4e07c71 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:08:48.409179 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edd99f01-9ac0-4577-9371-8e2bf4e07c71 None admin] RBAC: Authorization granted {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:08:48.428080 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: [pid: 88550|app: 0|req: 431/848] 10.222.0.26 () {56 vars in 1143 bytes} [Wed Aug 17 19:08:48 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 19:08:48.434411 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38b5ef1a-8856-421c-a337-3e63c08f115c None admin] Authenticating user token {{(pid=88551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:08:48.540270 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38b5ef1a-8856-421c-a337-3e63c08f115c None admin] Validating token access rules against request {{(pid=88551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:08:48.576085 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-514c88f9-3e82-4742-993c-f2d7346fff72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '819d41a279e64291acc60de51e1530ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:08:48.576628 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-514c88f9-3e82-4742-993c-f2d7346fff72 None admin] REQUEST_METHOD: `GET` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:08:48.576900 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-514c88f9-3e82-4742-993c-f2d7346fff72 None admin] SCRIPT_NAME: `/identity` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:08:48.577165 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-514c88f9-3e82-4742-993c-f2d7346fff72 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:08:48.588320 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-514c88f9-3e82-4742-993c-f2d7346fff72 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:08:48.590317 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-514c88f9-3e82-4742-993c-f2d7346fff72 None admin] RBAC: Authorization granted {{(pid=88551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:08:48.605788 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application [None req-514c88f9-3e82-4742-993c-f2d7346fff72 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 19:08:48.605788 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 19:08:48.605788 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 19:08:48.605788 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 19:08:48.605788 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 19:08:48.605788 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 19:08:48.605788 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 19:08:48.605788 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 19:08:48.605788 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 19:08:48.605788 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 19:08:48.605788 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 19:08:48.605788 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 19:08:48.605788 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 17 19:08:48.605788 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 17 19:08:48.605788 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 17 19:08:48.605788 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 17 19:08:48.607831 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 19:08:48.607831 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 19:08:48.607831 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 19:08:48.607831 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 19:08:48.607831 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 19:08:48.607831 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 19:08:48.607831 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 19:08:48.607831 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application with Lock( Aug 17 19:08:48.607831 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 19:08:48.607831 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application return self._enter() Aug 17 19:08:48.607831 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 19:08:48.607831 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 19:08:48.607831 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 19:08:48.607831 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application return self.creator() Aug 17 19:08:48.607831 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 19:08:48.607831 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application created_value = creator( Aug 17 19:08:48.607831 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 17 19:08:48.608975 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 17 19:08:48.608975 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 19:08:48.608975 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application Aug 17 19:08:48.608975 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: [pid: 88551|app: 0|req: 418/849] 10.222.0.26 () {56 vars in 1108 bytes} [Wed Aug 17 19:08:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 19:08:48.613489 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edd99f01-9ac0-4577-9371-8e2bf4e07c71 None admin] Authenticating user token {{(pid=88550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:08:48.721490 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edd99f01-9ac0-4577-9371-8e2bf4e07c71 None admin] Validating token access rules against request {{(pid=88550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:08:48.723845 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG dbcounter [-] [88550] Writing DB stats keystone:SELECT=100 {{(pid=88550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:08:48.756122 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a29a331-3ecb-4d25-a8b6-32b2ab33f901 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '819d41a279e64291acc60de51e1530ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:08:48.756775 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a29a331-3ecb-4d25-a8b6-32b2ab33f901 None admin] REQUEST_METHOD: `GET` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:08:48.757058 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a29a331-3ecb-4d25-a8b6-32b2ab33f901 None admin] SCRIPT_NAME: `/identity` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:08:48.757331 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a29a331-3ecb-4d25-a8b6-32b2ab33f901 None admin] PATH_INFO: `/v3/domains` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:08:48.757997 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a29a331-3ecb-4d25-a8b6-32b2ab33f901 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88550) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 19:08:48.758301 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a29a331-3ecb-4d25-a8b6-32b2ab33f901 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:08:48.759735 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a29a331-3ecb-4d25-a8b6-32b2ab33f901 None admin] RBAC: Authorization granted {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:08:48.772736 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: [pid: 88550|app: 0|req: 432/850] 10.222.0.26 () {56 vars in 1109 bytes} [Wed Aug 17 19:08:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 19:08:48.779808 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-514c88f9-3e82-4742-993c-f2d7346fff72 None admin] Authenticating user token {{(pid=88551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:08:48.782915 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG dbcounter [-] [88551] Writing DB stats keystone:SELECT=100 {{(pid=88551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:08:48.880027 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-514c88f9-3e82-4742-993c-f2d7346fff72 None admin] Validating token access rules against request {{(pid=88551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:08:48.913769 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-369de914-ed00-4437-9081-292b5c95760d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '819d41a279e64291acc60de51e1530ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:08:48.914385 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-369de914-ed00-4437-9081-292b5c95760d None admin] REQUEST_METHOD: `GET` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:08:48.914700 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-369de914-ed00-4437-9081-292b5c95760d None admin] SCRIPT_NAME: `/identity` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:08:48.914974 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-369de914-ed00-4437-9081-292b5c95760d None admin] PATH_INFO: `/v3/projects/service` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:08:48.921776 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-369de914-ed00-4437-9081-292b5c95760d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:08:48.923320 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-369de914-ed00-4437-9081-292b5c95760d None admin] RBAC: Authorization granted {{(pid=88551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:08:48.934310 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application [None req-369de914-ed00-4437-9081-292b5c95760d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 17 19:08:48.934310 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 19:08:48.934310 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 19:08:48.934310 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 19:08:48.934310 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 19:08:48.934310 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 19:08:48.934310 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 19:08:48.934310 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 19:08:48.934310 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 19:08:48.934310 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 19:08:48.934310 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 19:08:48.934310 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 19:08:48.934310 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 17 19:08:48.934310 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 17 19:08:48.934310 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 17 19:08:48.935658 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 17 19:08:48.935658 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 19:08:48.935658 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 19:08:48.935658 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 19:08:48.935658 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 19:08:48.935658 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 19:08:48.935658 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 19:08:48.935658 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 19:08:48.935658 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application with Lock( Aug 17 19:08:48.935658 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 19:08:48.935658 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application return self._enter() Aug 17 19:08:48.935658 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 19:08:48.935658 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 19:08:48.935658 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 19:08:48.935658 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application return self.creator() Aug 17 19:08:48.935658 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 19:08:48.935658 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application created_value = creator( Aug 17 19:08:48.936912 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 17 19:08:48.936912 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 17 19:08:48.936912 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 17 19:08:48.936912 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 17 19:08:48.936912 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 17 19:08:48.936912 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 17 19:08:48.936912 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 17 19:08:48.936912 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application Aug 17 19:08:48.936912 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: [pid: 88551|app: 0|req: 419/851] 10.222.0.26 () {56 vars in 1111 bytes} [Wed Aug 17 19:08:48 2022] GET /identity/v3/projects/service => generated 88 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 19:08:48.942261 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a29a331-3ecb-4d25-a8b6-32b2ab33f901 None admin] Authenticating user token {{(pid=88550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:08:49.041188 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a29a331-3ecb-4d25-a8b6-32b2ab33f901 None admin] Validating token access rules against request {{(pid=88550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:08:49.075462 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff71fbdc-c8e6-42a2-974f-85155ffac882 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '819d41a279e64291acc60de51e1530ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:08:49.076102 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff71fbdc-c8e6-42a2-974f-85155ffac882 None admin] REQUEST_METHOD: `GET` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:08:49.076320 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff71fbdc-c8e6-42a2-974f-85155ffac882 None admin] SCRIPT_NAME: `/identity` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:08:49.076587 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff71fbdc-c8e6-42a2-974f-85155ffac882 None admin] PATH_INFO: `/v3/projects` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:08:49.077262 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff71fbdc-c8e6-42a2-974f-85155ffac882 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88550) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 19:08:49.077563 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff71fbdc-c8e6-42a2-974f-85155ffac882 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:08:49.079002 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff71fbdc-c8e6-42a2-974f-85155ffac882 None admin] RBAC: Authorization granted {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:08:49.090532 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: [pid: 88550|app: 0|req: 433/852] 10.222.0.26 () {56 vars in 1148 bytes} [Wed Aug 17 19:08:48 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 19:08:49.097084 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-369de914-ed00-4437-9081-292b5c95760d None admin] Authenticating user token {{(pid=88551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:08:49.159081 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG dbcounter [-] [88551] Writing DB stats keystone:SELECT=100 {{(pid=88551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:08:49.198684 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-369de914-ed00-4437-9081-292b5c95760d None admin] Validating token access rules against request {{(pid=88551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:08:49.231755 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b339c3b-043a-426d-9be0-b6b812ff32bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '819d41a279e64291acc60de51e1530ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:08:49.232393 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b339c3b-043a-426d-9be0-b6b812ff32bb None admin] REQUEST_METHOD: `PUT` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:08:49.232680 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b339c3b-043a-426d-9be0-b6b812ff32bb None admin] SCRIPT_NAME: `/identity` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:08:49.232954 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b339c3b-043a-426d-9be0-b6b812ff32bb None admin] PATH_INFO: `/v3/projects/4bbf6c5abd684d899d09a08b0847d81c/users/6478a47e33024d1abc99f078dbc30787/roles/c798e3cf305b42dc8579aac6f3229a4b` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:08:49.248428 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b339c3b-043a-426d-9be0-b6b812ff32bb None admin] RBAC: Authorizing `identity:create_grant(project_id=4bbf6c5abd684d899d09a08b0847d81c, user_id=6478a47e33024d1abc99f078dbc30787, role_id=c798e3cf305b42dc8579aac6f3229a4b)` {{(pid=88551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:08:49.249932 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b339c3b-043a-426d-9be0-b6b812ff32bb None admin] RBAC: Authorization granted {{(pid=88551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:08:49.306591 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: [pid: 88551|app: 0|req: 420/853] 10.222.0.26 () {58 vars in 1439 bytes} [Wed Aug 17 19:08:49 2022] PUT /identity/v3/projects/4bbf6c5abd684d899d09a08b0847d81c/users/6478a47e33024d1abc99f078dbc30787/roles/c798e3cf305b42dc8579aac6f3229a4b => generated 0 bytes in 210 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 19:08:51.500104 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ed2b84-6525-496d-8b2b-eeb903084d9f None None] REQUEST_METHOD: `GET` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:08:51.500659 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ed2b84-6525-496d-8b2b-eeb903084d9f None None] SCRIPT_NAME: `/identity` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:08:51.500659 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ed2b84-6525-496d-8b2b-eeb903084d9f None None] PATH_INFO: `/` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:08:51.501990 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: [pid: 88550|app: 0|req: 434/854] 10.222.0.26 () {54 vars in 927 bytes} [Wed Aug 17 19:08:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 19:08:51.507209 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb32ecf-7a1e-40f5-9ba9-68de9e4ad106 None None] REQUEST_METHOD: `POST` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:08:51.507648 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb32ecf-7a1e-40f5-9ba9-68de9e4ad106 None None] SCRIPT_NAME: `/identity` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:08:51.507740 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb32ecf-7a1e-40f5-9ba9-68de9e4ad106 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:08:51.525551 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.auth.core [None req-0bb32ecf-7a1e-40f5-9ba9-68de9e4ad106 None None] MFA Rules not processed for user `819d41a279e64291acc60de51e1530ae`. Rule list: `[]` (Enabled: `True`). {{(pid=88551) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 19:08:51.527265 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.common.fernet_utils [None req-0bb32ecf-7a1e-40f5-9ba9-68de9e4ad106 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:08:51.594139 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: [pid: 88551|app: 0|req: 421/855] 10.222.0.26 () {58 vars in 1024 bytes} [Wed Aug 17 19:08:51 2022] POST /identity/v3/auth/tokens => generated 1869 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 17 19:08:51.927992 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4ed2b84-6525-496d-8b2b-eeb903084d9f None None] Authenticating user token {{(pid=88550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:08:51.957166 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG dbcounter [-] [88550] Writing DB stats keystone:SELECT=100 {{(pid=88550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:08:52.031695 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4ed2b84-6525-496d-8b2b-eeb903084d9f None None] Validating token access rules against request {{(pid=88550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:08:52.065650 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-973721c9-8954-4a8f-a190-d042e6cb1bf9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '819d41a279e64291acc60de51e1530ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:08:52.066265 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-973721c9-8954-4a8f-a190-d042e6cb1bf9 None admin] REQUEST_METHOD: `GET` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:08:52.066572 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-973721c9-8954-4a8f-a190-d042e6cb1bf9 None admin] SCRIPT_NAME: `/identity` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:08:52.066842 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-973721c9-8954-4a8f-a190-d042e6cb1bf9 None admin] PATH_INFO: `/v3/roles/service` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:08:52.077560 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-973721c9-8954-4a8f-a190-d042e6cb1bf9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 17 19:08:52.082235 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application [None req-973721c9-8954-4a8f-a190-d042e6cb1bf9 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 17 19:08:52.082235 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 19:08:52.082235 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 19:08:52.082235 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 19:08:52.082235 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 19:08:52.082235 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 19:08:52.082235 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 19:08:52.082235 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 19:08:52.082235 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 19:08:52.082235 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 19:08:52.082235 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 19:08:52.082235 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 19:08:52.082235 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 17 19:08:52.082235 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 17 19:08:52.082235 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 17 19:08:52.082235 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 17 19:08:52.083461 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 17 19:08:52.083461 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 17 19:08:52.083461 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 17 19:08:52.083461 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 17 19:08:52.083461 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 19:08:52.083461 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 19:08:52.083461 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 19:08:52.083461 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 19:08:52.083461 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 19:08:52.083461 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 19:08:52.083461 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 19:08:52.083461 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application with Lock( Aug 17 19:08:52.083461 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 19:08:52.083461 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return self._enter() Aug 17 19:08:52.083461 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 19:08:52.083461 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 19:08:52.084349 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 19:08:52.084349 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return self.creator() Aug 17 19:08:52.084349 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 19:08:52.084349 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application created_value = creator( Aug 17 19:08:52.084349 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 17 19:08:52.084349 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 17 19:08:52.084349 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 17 19:08:52.084349 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 17 19:08:52.084349 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 17 19:08:52.084349 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 17 19:08:52.084349 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 17 19:08:52.084349 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application Aug 17 19:08:52.084349 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: [pid: 88550|app: 0|req: 435/856] 10.222.0.26 () {56 vars in 1102 bytes} [Wed Aug 17 19:08:51 2022] GET /identity/v3/roles/service => generated 85 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 19:08:52.089527 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bb32ecf-7a1e-40f5-9ba9-68de9e4ad106 None None] Authenticating user token {{(pid=88551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:08:52.132278 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG dbcounter [-] [88551] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:08:52.186908 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bb32ecf-7a1e-40f5-9ba9-68de9e4ad106 None None] Validating token access rules against request {{(pid=88551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:08:52.220266 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbc7a857-75e4-4316-8e9b-28747dedd6df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '819d41a279e64291acc60de51e1530ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:08:52.243399 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc7a857-75e4-4316-8e9b-28747dedd6df None admin] REQUEST_METHOD: `GET` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:08:52.243399 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc7a857-75e4-4316-8e9b-28747dedd6df None admin] SCRIPT_NAME: `/identity` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:08:52.243399 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc7a857-75e4-4316-8e9b-28747dedd6df None admin] PATH_INFO: `/v3/roles` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:08:52.243399 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbc7a857-75e4-4316-8e9b-28747dedd6df None admin] RBAC: Adding query filter params (name=service) {{(pid=88551) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 19:08:52.243399 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbc7a857-75e4-4316-8e9b-28747dedd6df None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:08:52.243399 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbc7a857-75e4-4316-8e9b-28747dedd6df None admin] RBAC: Authorization granted {{(pid=88551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:08:52.243987 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: [pid: 88551|app: 0|req: 422/857] 10.222.0.26 () {56 vars in 1103 bytes} [Wed Aug 17 19:08:52 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 19:08:52.244070 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-973721c9-8954-4a8f-a190-d042e6cb1bf9 None admin] Authenticating user token {{(pid=88550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:08:52.320903 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG dbcounter [-] [88550] Writing DB stats keystone:SELECT=100 {{(pid=88550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:08:52.336795 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-973721c9-8954-4a8f-a190-d042e6cb1bf9 None admin] Validating token access rules against request {{(pid=88550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:08:52.369172 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d9163ee-5ddd-499f-9b57-a72a34e26f26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '819d41a279e64291acc60de51e1530ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:08:52.370379 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d9163ee-5ddd-499f-9b57-a72a34e26f26 None admin] REQUEST_METHOD: `GET` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:08:52.370684 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d9163ee-5ddd-499f-9b57-a72a34e26f26 None admin] SCRIPT_NAME: `/identity` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:08:52.370954 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d9163ee-5ddd-499f-9b57-a72a34e26f26 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:08:52.382030 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d9163ee-5ddd-499f-9b57-a72a34e26f26 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:08:52.387124 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d9163ee-5ddd-499f-9b57-a72a34e26f26 None admin] RBAC: Authorization granted {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:08:52.397122 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application [None req-7d9163ee-5ddd-499f-9b57-a72a34e26f26 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 19:08:52.397122 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 19:08:52.397122 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 19:08:52.397122 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 19:08:52.397122 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 19:08:52.397122 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 19:08:52.397122 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 19:08:52.397122 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 19:08:52.397122 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 19:08:52.397122 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 19:08:52.397122 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 19:08:52.397122 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 19:08:52.397122 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 17 19:08:52.397122 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 17 19:08:52.397122 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 17 19:08:52.397122 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 17 19:08:52.398295 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 19:08:52.398295 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 19:08:52.398295 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 19:08:52.398295 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 19:08:52.398295 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 19:08:52.398295 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 19:08:52.398295 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 19:08:52.398295 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application with Lock( Aug 17 19:08:52.398295 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 19:08:52.398295 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return self._enter() Aug 17 19:08:52.398295 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 19:08:52.398295 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 19:08:52.398295 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 19:08:52.398295 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return self.creator() Aug 17 19:08:52.398295 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 19:08:52.398295 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application created_value = creator( Aug 17 19:08:52.398295 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 17 19:08:52.399270 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 17 19:08:52.399270 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 19:08:52.399270 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application Aug 17 19:08:52.399270 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: [pid: 88550|app: 0|req: 436/858] 10.222.0.26 () {56 vars in 1108 bytes} [Wed Aug 17 19:08:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 19:08:52.404209 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbc7a857-75e4-4316-8e9b-28747dedd6df None admin] Authenticating user token {{(pid=88551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:08:52.504740 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbc7a857-75e4-4316-8e9b-28747dedd6df None admin] Validating token access rules against request {{(pid=88551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:08:52.507161 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG dbcounter [-] [88551] Writing DB stats keystone:SELECT=100 {{(pid=88551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:08:52.537613 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d64911b7-b45e-4019-a2df-08909d2a451e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '819d41a279e64291acc60de51e1530ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:08:52.538214 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d64911b7-b45e-4019-a2df-08909d2a451e None admin] REQUEST_METHOD: `GET` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:08:52.538490 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d64911b7-b45e-4019-a2df-08909d2a451e None admin] SCRIPT_NAME: `/identity` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:08:52.538856 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d64911b7-b45e-4019-a2df-08909d2a451e None admin] PATH_INFO: `/v3/domains` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:08:52.539521 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d64911b7-b45e-4019-a2df-08909d2a451e None admin] RBAC: Adding query filter params (name=Default) {{(pid=88551) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 19:08:52.539838 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d64911b7-b45e-4019-a2df-08909d2a451e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:08:52.541183 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d64911b7-b45e-4019-a2df-08909d2a451e None admin] RBAC: Authorization granted {{(pid=88551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:08:52.552528 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: [pid: 88551|app: 0|req: 423/859] 10.222.0.26 () {56 vars in 1109 bytes} [Wed Aug 17 19:08:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 19:08:52.559006 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d9163ee-5ddd-499f-9b57-a72a34e26f26 None admin] Authenticating user token {{(pid=88550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:08:52.657735 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d9163ee-5ddd-499f-9b57-a72a34e26f26 None admin] Validating token access rules against request {{(pid=88550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:08:52.691592 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-304caa39-354c-48c2-a710-7e67c4ac14ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '819d41a279e64291acc60de51e1530ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:08:52.692238 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-304caa39-354c-48c2-a710-7e67c4ac14ab None admin] REQUEST_METHOD: `GET` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:08:52.692543 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-304caa39-354c-48c2-a710-7e67c4ac14ab None admin] SCRIPT_NAME: `/identity` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:08:52.692842 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-304caa39-354c-48c2-a710-7e67c4ac14ab None admin] PATH_INFO: `/v3/users/placement` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:08:52.695608 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG dbcounter [-] [88550] Writing DB stats keystone:SELECT=100 {{(pid=88550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:08:52.700474 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-304caa39-354c-48c2-a710-7e67c4ac14ab None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:08:52.701899 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-304caa39-354c-48c2-a710-7e67c4ac14ab None admin] RBAC: Authorization granted {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:08:52.712693 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application [None req-304caa39-354c-48c2-a710-7e67c4ac14ab None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 17 19:08:52.712693 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 19:08:52.712693 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 19:08:52.712693 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 19:08:52.712693 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 19:08:52.712693 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 19:08:52.712693 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 19:08:52.712693 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 19:08:52.712693 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 19:08:52.712693 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 19:08:52.712693 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 19:08:52.712693 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 19:08:52.712693 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 17 19:08:52.712693 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 17 19:08:52.712693 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 17 19:08:52.712693 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 17 19:08:52.714332 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 19:08:52.714332 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 19:08:52.714332 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 17 19:08:52.714332 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 17 19:08:52.714332 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 17 19:08:52.714332 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 17 19:08:52.714332 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 19:08:52.714332 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 19:08:52.714332 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 19:08:52.714332 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 19:08:52.714332 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 19:08:52.714332 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application with Lock( Aug 17 19:08:52.714332 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 19:08:52.714332 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return self._enter() Aug 17 19:08:52.714332 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 19:08:52.714332 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 19:08:52.714332 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 19:08:52.714332 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return self.creator() Aug 17 19:08:52.715420 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 19:08:52.715420 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application created_value = creator( Aug 17 19:08:52.715420 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 17 19:08:52.715420 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 17 19:08:52.715420 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 17 19:08:52.715420 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 17 19:08:52.715420 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 17 19:08:52.715420 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 17 19:08:52.715420 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 17 19:08:52.715420 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application Aug 17 19:08:52.715420 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: [pid: 88550|app: 0|req: 437/860] 10.222.0.26 () {56 vars in 1108 bytes} [Wed Aug 17 19:08:52 2022] GET /identity/v3/users/placement => generated 87 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 19:08:52.720214 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d64911b7-b45e-4019-a2df-08909d2a451e None admin] Authenticating user token {{(pid=88551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:08:52.819949 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d64911b7-b45e-4019-a2df-08909d2a451e None admin] Validating token access rules against request {{(pid=88551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:08:52.852550 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eff052d0-e196-4746-bef3-45ca46c06d5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '819d41a279e64291acc60de51e1530ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:08:52.853135 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff052d0-e196-4746-bef3-45ca46c06d5c None admin] REQUEST_METHOD: `GET` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:08:52.853409 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff052d0-e196-4746-bef3-45ca46c06d5c None admin] SCRIPT_NAME: `/identity` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:08:52.853691 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff052d0-e196-4746-bef3-45ca46c06d5c None admin] PATH_INFO: `/v3/users` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:08:52.855096 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eff052d0-e196-4746-bef3-45ca46c06d5c None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=88551) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 19:08:52.855418 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eff052d0-e196-4746-bef3-45ca46c06d5c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:08:52.856807 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eff052d0-e196-4746-bef3-45ca46c06d5c None admin] RBAC: Authorization granted {{(pid=88551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:08:52.873416 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: [pid: 88551|app: 0|req: 424/861] 10.222.0.26 () {56 vars in 1143 bytes} [Wed Aug 17 19:08:52 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 19:08:52.879352 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-304caa39-354c-48c2-a710-7e67c4ac14ab None admin] Authenticating user token {{(pid=88550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:08:52.979671 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-304caa39-354c-48c2-a710-7e67c4ac14ab None admin] Validating token access rules against request {{(pid=88550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:08:53.012111 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-391e98bb-a4b2-400d-ba1c-c5c7db81073a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '819d41a279e64291acc60de51e1530ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:08:53.012705 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-391e98bb-a4b2-400d-ba1c-c5c7db81073a None admin] REQUEST_METHOD: `GET` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:08:53.012987 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-391e98bb-a4b2-400d-ba1c-c5c7db81073a None admin] SCRIPT_NAME: `/identity` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:08:53.013264 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-391e98bb-a4b2-400d-ba1c-c5c7db81073a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:08:53.073863 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG dbcounter [-] [88550] Writing DB stats keystone:SELECT=100 {{(pid=88550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:08:53.080374 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-391e98bb-a4b2-400d-ba1c-c5c7db81073a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:08:53.081815 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-391e98bb-a4b2-400d-ba1c-c5c7db81073a None admin] RBAC: Authorization granted {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:08:53.177176 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: [pid: 88550|app: 0|req: 438/862] 10.222.0.26 () {58 vars in 1282 bytes} [Wed Aug 17 19:08:52 2022] GET /identity/v3/auth/tokens => generated 1869 bytes in 298 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 17 19:08:53.183035 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eff052d0-e196-4746-bef3-45ca46c06d5c None admin] Authenticating user token {{(pid=88551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:08:53.208503 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG dbcounter [-] [88551] Writing DB stats keystone:SELECT=100 {{(pid=88551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:08:53.281800 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eff052d0-e196-4746-bef3-45ca46c06d5c None admin] Validating token access rules against request {{(pid=88551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:08:53.315565 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2ee8103-c28b-4c08-acc3-a523ec9a91be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '819d41a279e64291acc60de51e1530ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:08:53.316201 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ee8103-c28b-4c08-acc3-a523ec9a91be None admin] REQUEST_METHOD: `GET` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:08:53.316461 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ee8103-c28b-4c08-acc3-a523ec9a91be None admin] SCRIPT_NAME: `/identity` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:08:53.316863 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ee8103-c28b-4c08-acc3-a523ec9a91be None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:08:53.328942 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2ee8103-c28b-4c08-acc3-a523ec9a91be None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:08:53.330365 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2ee8103-c28b-4c08-acc3-a523ec9a91be None admin] RBAC: Authorization granted {{(pid=88551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:08:53.345519 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application [None req-b2ee8103-c28b-4c08-acc3-a523ec9a91be None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 19:08:53.345519 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 19:08:53.345519 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 19:08:53.345519 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 19:08:53.345519 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 19:08:53.345519 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 19:08:53.345519 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 19:08:53.345519 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 19:08:53.345519 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 19:08:53.345519 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 19:08:53.345519 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 19:08:53.345519 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 19:08:53.345519 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 17 19:08:53.345519 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 17 19:08:53.345519 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 17 19:08:53.345519 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 17 19:08:53.346552 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 19:08:53.346552 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 19:08:53.346552 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 19:08:53.346552 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 19:08:53.346552 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 19:08:53.346552 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 19:08:53.346552 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 19:08:53.346552 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application with Lock( Aug 17 19:08:53.346552 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 19:08:53.346552 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application return self._enter() Aug 17 19:08:53.346552 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 19:08:53.346552 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 19:08:53.346552 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 19:08:53.346552 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application return self.creator() Aug 17 19:08:53.346552 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 19:08:53.346552 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application created_value = creator( Aug 17 19:08:53.346552 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 17 19:08:53.357299 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 17 19:08:53.357299 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 19:08:53.357299 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application Aug 17 19:08:53.357299 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: [pid: 88551|app: 0|req: 425/863] 10.222.0.26 () {56 vars in 1108 bytes} [Wed Aug 17 19:08:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 19:08:53.357596 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-391e98bb-a4b2-400d-ba1c-c5c7db81073a None admin] Authenticating user token {{(pid=88550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:08:53.444626 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG dbcounter [-] [88550] Writing DB stats keystone:SELECT=100 {{(pid=88550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:08:53.451449 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-391e98bb-a4b2-400d-ba1c-c5c7db81073a None admin] Validating token access rules against request {{(pid=88550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:08:53.485149 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67c5ee02-74d3-452e-b442-226aef045ff9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '819d41a279e64291acc60de51e1530ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:08:53.485747 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c5ee02-74d3-452e-b442-226aef045ff9 None admin] REQUEST_METHOD: `GET` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:08:53.486029 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c5ee02-74d3-452e-b442-226aef045ff9 None admin] SCRIPT_NAME: `/identity` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:08:53.486301 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c5ee02-74d3-452e-b442-226aef045ff9 None admin] PATH_INFO: `/v3/domains` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:08:53.486976 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67c5ee02-74d3-452e-b442-226aef045ff9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88550) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 19:08:53.487319 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67c5ee02-74d3-452e-b442-226aef045ff9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:08:53.488729 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67c5ee02-74d3-452e-b442-226aef045ff9 None admin] RBAC: Authorization granted {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:08:53.500299 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: [pid: 88550|app: 0|req: 439/864] 10.222.0.26 () {56 vars in 1109 bytes} [Wed Aug 17 19:08:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 19:08:53.506083 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2ee8103-c28b-4c08-acc3-a523ec9a91be None admin] Authenticating user token {{(pid=88551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:08:53.582927 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG dbcounter [-] [88551] Writing DB stats keystone:SELECT=100 {{(pid=88551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:08:53.607111 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2ee8103-c28b-4c08-acc3-a523ec9a91be None admin] Validating token access rules against request {{(pid=88551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:08:53.640800 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a2e3a6f-8b67-4ee5-aada-a9f4c6de6261 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '819d41a279e64291acc60de51e1530ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:08:53.641411 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a2e3a6f-8b67-4ee5-aada-a9f4c6de6261 None admin] REQUEST_METHOD: `GET` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:08:53.641685 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a2e3a6f-8b67-4ee5-aada-a9f4c6de6261 None admin] SCRIPT_NAME: `/identity` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:08:53.641951 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a2e3a6f-8b67-4ee5-aada-a9f4c6de6261 None admin] PATH_INFO: `/v3/projects/service` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:08:53.648729 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a2e3a6f-8b67-4ee5-aada-a9f4c6de6261 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:08:53.650143 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a2e3a6f-8b67-4ee5-aada-a9f4c6de6261 None admin] RBAC: Authorization granted {{(pid=88551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:08:53.662914 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application [None req-3a2e3a6f-8b67-4ee5-aada-a9f4c6de6261 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 17 19:08:53.662914 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 19:08:53.662914 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 19:08:53.662914 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 19:08:53.662914 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 19:08:53.662914 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 19:08:53.662914 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 19:08:53.662914 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 19:08:53.662914 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 19:08:53.662914 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 19:08:53.662914 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 19:08:53.662914 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 19:08:53.662914 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 17 19:08:53.662914 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 17 19:08:53.662914 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 17 19:08:53.663964 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 17 19:08:53.663964 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 19:08:53.663964 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 19:08:53.663964 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 19:08:53.663964 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 19:08:53.663964 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 19:08:53.663964 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 19:08:53.663964 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 19:08:53.663964 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application with Lock( Aug 17 19:08:53.663964 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 19:08:53.663964 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application return self._enter() Aug 17 19:08:53.663964 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 19:08:53.663964 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 19:08:53.663964 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 19:08:53.663964 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application return self.creator() Aug 17 19:08:53.663964 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 19:08:53.663964 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application created_value = creator( Aug 17 19:08:53.665147 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 17 19:08:53.665147 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 17 19:08:53.665147 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 17 19:08:53.665147 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 17 19:08:53.665147 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 17 19:08:53.665147 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 17 19:08:53.665147 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 17 19:08:53.665147 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application Aug 17 19:08:53.665147 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: [pid: 88551|app: 0|req: 426/865] 10.222.0.26 () {56 vars in 1111 bytes} [Wed Aug 17 19:08:53 2022] GET /identity/v3/projects/service => generated 88 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 19:08:53.669877 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67c5ee02-74d3-452e-b442-226aef045ff9 None admin] Authenticating user token {{(pid=88550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:08:53.772182 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67c5ee02-74d3-452e-b442-226aef045ff9 None admin] Validating token access rules against request {{(pid=88550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:08:53.806488 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b69cc9e-c529-4312-a14c-a8f70cab8143 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '819d41a279e64291acc60de51e1530ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:08:53.807670 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b69cc9e-c529-4312-a14c-a8f70cab8143 None admin] REQUEST_METHOD: `GET` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:08:53.807946 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b69cc9e-c529-4312-a14c-a8f70cab8143 None admin] SCRIPT_NAME: `/identity` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:08:53.808214 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b69cc9e-c529-4312-a14c-a8f70cab8143 None admin] PATH_INFO: `/v3/projects` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:08:53.808933 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b69cc9e-c529-4312-a14c-a8f70cab8143 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88550) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 19:08:53.809239 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b69cc9e-c529-4312-a14c-a8f70cab8143 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:08:53.810798 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b69cc9e-c529-4312-a14c-a8f70cab8143 None admin] RBAC: Authorization granted {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:08:53.823165 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: [pid: 88550|app: 0|req: 440/866] 10.222.0.26 () {56 vars in 1148 bytes} [Wed Aug 17 19:08:53 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 19:08:53.829334 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a2e3a6f-8b67-4ee5-aada-a9f4c6de6261 None admin] Authenticating user token {{(pid=88551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:08:53.928551 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a2e3a6f-8b67-4ee5-aada-a9f4c6de6261 None admin] Validating token access rules against request {{(pid=88551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:08:53.963803 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-464081e3-78b6-41c5-8170-393f0fa2707b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '819d41a279e64291acc60de51e1530ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:08:53.964403 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-464081e3-78b6-41c5-8170-393f0fa2707b None admin] REQUEST_METHOD: `GET` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:08:53.964683 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-464081e3-78b6-41c5-8170-393f0fa2707b None admin] SCRIPT_NAME: `/identity` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:08:53.964959 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-464081e3-78b6-41c5-8170-393f0fa2707b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:08:53.965682 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-464081e3-78b6-41c5-8170-393f0fa2707b None admin] RBAC: Adding query filter params (role.id=c798e3cf305b42dc8579aac6f3229a4b, scope.project.id=4bbf6c5abd684d899d09a08b0847d81c, user.id=6478a47e33024d1abc99f078dbc30787) {{(pid=88551) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 19:08:53.965993 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-464081e3-78b6-41c5-8170-393f0fa2707b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:08:53.967456 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-464081e3-78b6-41c5-8170-393f0fa2707b None admin] RBAC: Authorization granted {{(pid=88551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:08:53.969237 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG dbcounter [-] [88551] Writing DB stats keystone:SELECT=100 {{(pid=88551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:08:53.973714 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: [pid: 88551|app: 0|req: 427/867] 10.222.0.26 () {56 vars in 1374 bytes} [Wed Aug 17 19:08:53 2022] GET /identity/v3/role_assignments?user.id=6478a47e33024d1abc99f078dbc30787&scope.project.id=4bbf6c5abd684d899d09a08b0847d81c&role.id=c798e3cf305b42dc8579aac6f3229a4b => generated 608 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 19:08:56.194429 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2189523-a915-42c8-8c19-eb426de86f52 None None] REQUEST_METHOD: `GET` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:08:56.194967 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2189523-a915-42c8-8c19-eb426de86f52 None None] SCRIPT_NAME: `/identity` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:08:56.195107 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2189523-a915-42c8-8c19-eb426de86f52 None None] PATH_INFO: `/` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:08:56.196479 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: [pid: 88550|app: 0|req: 441/868] 10.222.0.26 () {54 vars in 927 bytes} [Wed Aug 17 19:08:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 19:08:56.202200 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9251ff0c-0772-4116-90eb-0ed94c4e6612 None None] REQUEST_METHOD: `POST` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:08:56.202665 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9251ff0c-0772-4116-90eb-0ed94c4e6612 None None] SCRIPT_NAME: `/identity` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:08:56.202766 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9251ff0c-0772-4116-90eb-0ed94c4e6612 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:08:56.220928 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.auth.core [None req-9251ff0c-0772-4116-90eb-0ed94c4e6612 None None] MFA Rules not processed for user `819d41a279e64291acc60de51e1530ae`. Rule list: `[]` (Enabled: `True`). {{(pid=88551) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 19:08:56.222093 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.common.fernet_utils [None req-9251ff0c-0772-4116-90eb-0ed94c4e6612 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:08:56.290781 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: [pid: 88551|app: 0|req: 428/869] 10.222.0.26 () {58 vars in 1024 bytes} [Wed Aug 17 19:08:56 2022] POST /identity/v3/auth/tokens => generated 1869 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 17 19:08:56.626393 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2189523-a915-42c8-8c19-eb426de86f52 None None] Authenticating user token {{(pid=88550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:08:56.644496 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG dbcounter [-] [88550] Writing DB stats keystone:SELECT=100 {{(pid=88550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:08:56.727545 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2189523-a915-42c8-8c19-eb426de86f52 None None] Validating token access rules against request {{(pid=88550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:08:56.764937 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a29d5db-29dc-456f-b8f6-97996c4b5626 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '819d41a279e64291acc60de51e1530ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:08:56.765550 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a29d5db-29dc-456f-b8f6-97996c4b5626 None admin] REQUEST_METHOD: `GET` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:08:56.765826 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a29d5db-29dc-456f-b8f6-97996c4b5626 None admin] SCRIPT_NAME: `/identity` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:08:56.766096 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a29d5db-29dc-456f-b8f6-97996c4b5626 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:08:56.776670 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a29d5db-29dc-456f-b8f6-97996c4b5626 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 17 19:08:56.781548 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application [None req-7a29d5db-29dc-456f-b8f6-97996c4b5626 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 17 19:08:56.781548 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 19:08:56.781548 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 19:08:56.781548 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 19:08:56.781548 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 19:08:56.781548 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 19:08:56.781548 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 19:08:56.781548 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 19:08:56.781548 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 19:08:56.781548 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 19:08:56.781548 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 19:08:56.781548 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 19:08:56.781548 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 17 19:08:56.781548 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 17 19:08:56.781548 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 17 19:08:56.781548 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 17 19:08:56.782679 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 17 19:08:56.782679 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 17 19:08:56.782679 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 17 19:08:56.782679 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 17 19:08:56.782679 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 19:08:56.782679 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 19:08:56.782679 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 19:08:56.782679 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 19:08:56.782679 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 19:08:56.782679 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 19:08:56.782679 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 19:08:56.782679 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application with Lock( Aug 17 19:08:56.782679 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 19:08:56.782679 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return self._enter() Aug 17 19:08:56.782679 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 19:08:56.782679 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 19:08:56.783725 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 19:08:56.783725 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return self.creator() Aug 17 19:08:56.783725 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 19:08:56.783725 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application created_value = creator( Aug 17 19:08:56.783725 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 17 19:08:56.783725 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 17 19:08:56.783725 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 17 19:08:56.783725 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 17 19:08:56.783725 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 17 19:08:56.783725 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 17 19:08:56.783725 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 17 19:08:56.783725 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application Aug 17 19:08:56.783725 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: [pid: 88550|app: 0|req: 442/870] 10.222.0.26 () {56 vars in 1096 bytes} [Wed Aug 17 19:08:56 2022] GET /identity/v3/roles/admin => generated 83 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 19:08:56.788853 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9251ff0c-0772-4116-90eb-0ed94c4e6612 None None] Authenticating user token {{(pid=88551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:08:56.888044 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9251ff0c-0772-4116-90eb-0ed94c4e6612 None None] Validating token access rules against request {{(pid=88551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:08:56.914031 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG dbcounter [-] [88551] Writing DB stats keystone:SELECT=100 {{(pid=88551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:08:56.921733 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37d1974c-2381-4aa6-bdab-ab870619aada None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '819d41a279e64291acc60de51e1530ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:08:56.922318 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d1974c-2381-4aa6-bdab-ab870619aada None admin] REQUEST_METHOD: `GET` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:08:56.922694 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d1974c-2381-4aa6-bdab-ab870619aada None admin] SCRIPT_NAME: `/identity` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:08:56.923028 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d1974c-2381-4aa6-bdab-ab870619aada None admin] PATH_INFO: `/v3/roles` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:08:56.923689 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37d1974c-2381-4aa6-bdab-ab870619aada None admin] RBAC: Adding query filter params (name=admin) {{(pid=88551) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 19:08:56.923992 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37d1974c-2381-4aa6-bdab-ab870619aada None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:08:56.925426 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37d1974c-2381-4aa6-bdab-ab870619aada None admin] RBAC: Authorization granted {{(pid=88551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:08:56.933708 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: [pid: 88551|app: 0|req: 429/871] 10.222.0.26 () {56 vars in 1099 bytes} [Wed Aug 17 19:08:56 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 19:08:56.939870 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a29d5db-29dc-456f-b8f6-97996c4b5626 None admin] Authenticating user token {{(pid=88550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:08:57.018278 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG dbcounter [-] [88550] Writing DB stats keystone:SELECT=100 {{(pid=88550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:08:57.041110 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a29d5db-29dc-456f-b8f6-97996c4b5626 None admin] Validating token access rules against request {{(pid=88550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:08:57.076458 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be467d32-ec59-4d70-be8f-59b7a250fd56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '819d41a279e64291acc60de51e1530ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:08:57.077085 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be467d32-ec59-4d70-be8f-59b7a250fd56 None admin] REQUEST_METHOD: `GET` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:08:57.077364 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be467d32-ec59-4d70-be8f-59b7a250fd56 None admin] SCRIPT_NAME: `/identity` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:08:57.077638 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be467d32-ec59-4d70-be8f-59b7a250fd56 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:08:57.087890 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be467d32-ec59-4d70-be8f-59b7a250fd56 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:08:57.089373 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be467d32-ec59-4d70-be8f-59b7a250fd56 None admin] RBAC: Authorization granted {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:08:57.104211 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application [None req-be467d32-ec59-4d70-be8f-59b7a250fd56 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 19:08:57.104211 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 19:08:57.104211 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 19:08:57.104211 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 19:08:57.104211 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 19:08:57.104211 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 19:08:57.104211 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 19:08:57.104211 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 19:08:57.104211 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 19:08:57.104211 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 19:08:57.104211 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 19:08:57.104211 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 19:08:57.104211 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 17 19:08:57.104211 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 17 19:08:57.104211 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 17 19:08:57.104211 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 17 19:08:57.109580 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 19:08:57.109580 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 19:08:57.109580 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 19:08:57.109580 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 19:08:57.109580 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 19:08:57.109580 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 19:08:57.109580 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 19:08:57.109580 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application with Lock( Aug 17 19:08:57.109580 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 19:08:57.109580 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return self._enter() Aug 17 19:08:57.109580 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 19:08:57.109580 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 19:08:57.109580 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 19:08:57.109580 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return self.creator() Aug 17 19:08:57.109580 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 19:08:57.109580 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application created_value = creator( Aug 17 19:08:57.109580 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 17 19:08:57.110895 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 17 19:08:57.110895 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 19:08:57.110895 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application Aug 17 19:08:57.110895 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: [pid: 88550|app: 0|req: 443/872] 10.222.0.26 () {56 vars in 1108 bytes} [Wed Aug 17 19:08:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 19:08:57.112417 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37d1974c-2381-4aa6-bdab-ab870619aada None admin] Authenticating user token {{(pid=88551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:08:57.220026 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37d1974c-2381-4aa6-bdab-ab870619aada None admin] Validating token access rules against request {{(pid=88551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:08:57.253538 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d30e3d15-5f43-4cf5-ab95-b421178ea3f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '819d41a279e64291acc60de51e1530ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:08:57.254129 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d30e3d15-5f43-4cf5-ab95-b421178ea3f8 None admin] REQUEST_METHOD: `GET` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:08:57.254411 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d30e3d15-5f43-4cf5-ab95-b421178ea3f8 None admin] SCRIPT_NAME: `/identity` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:08:57.254710 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d30e3d15-5f43-4cf5-ab95-b421178ea3f8 None admin] PATH_INFO: `/v3/domains` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:08:57.255347 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d30e3d15-5f43-4cf5-ab95-b421178ea3f8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88551) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 19:08:57.255649 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d30e3d15-5f43-4cf5-ab95-b421178ea3f8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:08:57.256995 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d30e3d15-5f43-4cf5-ab95-b421178ea3f8 None admin] RBAC: Authorization granted {{(pid=88551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:08:57.269255 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: [pid: 88551|app: 0|req: 430/873] 10.222.0.26 () {56 vars in 1109 bytes} [Wed Aug 17 19:08:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 19:08:57.275043 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be467d32-ec59-4d70-be8f-59b7a250fd56 None admin] Authenticating user token {{(pid=88550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:08:57.378303 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be467d32-ec59-4d70-be8f-59b7a250fd56 None admin] Validating token access rules against request {{(pid=88550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:08:57.406970 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG dbcounter [-] [88550] Writing DB stats keystone:SELECT=100 {{(pid=88550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:08:57.414768 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4440f6a-ae0a-4b97-955b-7579aa515054 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '819d41a279e64291acc60de51e1530ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:08:57.415391 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4440f6a-ae0a-4b97-955b-7579aa515054 None admin] REQUEST_METHOD: `GET` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:08:57.415671 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4440f6a-ae0a-4b97-955b-7579aa515054 None admin] SCRIPT_NAME: `/identity` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:08:57.415997 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4440f6a-ae0a-4b97-955b-7579aa515054 None admin] PATH_INFO: `/v3/users/placement` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:08:57.423331 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4440f6a-ae0a-4b97-955b-7579aa515054 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:08:57.424763 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4440f6a-ae0a-4b97-955b-7579aa515054 None admin] RBAC: Authorization granted {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:08:57.436543 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application [None req-b4440f6a-ae0a-4b97-955b-7579aa515054 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 17 19:08:57.436543 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 19:08:57.436543 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 19:08:57.436543 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 19:08:57.436543 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 19:08:57.436543 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 19:08:57.436543 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 19:08:57.436543 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 19:08:57.436543 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 19:08:57.436543 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 19:08:57.436543 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 19:08:57.436543 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 19:08:57.436543 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 17 19:08:57.436543 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 17 19:08:57.436543 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 17 19:08:57.436543 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 17 19:08:57.438335 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 19:08:57.438335 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 19:08:57.438335 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 17 19:08:57.438335 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 17 19:08:57.438335 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 17 19:08:57.438335 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 17 19:08:57.438335 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 19:08:57.438335 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 19:08:57.438335 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 19:08:57.438335 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 19:08:57.438335 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 19:08:57.438335 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application with Lock( Aug 17 19:08:57.438335 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 19:08:57.438335 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return self._enter() Aug 17 19:08:57.438335 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 19:08:57.438335 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 19:08:57.438335 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 19:08:57.438335 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return self.creator() Aug 17 19:08:57.440190 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 19:08:57.440190 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application created_value = creator( Aug 17 19:08:57.440190 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 17 19:08:57.440190 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 17 19:08:57.440190 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 17 19:08:57.440190 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 17 19:08:57.440190 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 17 19:08:57.440190 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 17 19:08:57.440190 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 17 19:08:57.440190 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application Aug 17 19:08:57.440190 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: [pid: 88550|app: 0|req: 444/874] 10.222.0.26 () {56 vars in 1108 bytes} [Wed Aug 17 19:08:57 2022] GET /identity/v3/users/placement => generated 87 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 19:08:57.444190 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d30e3d15-5f43-4cf5-ab95-b421178ea3f8 None admin] Authenticating user token {{(pid=88551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:08:57.494209 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG dbcounter [-] [88551] Writing DB stats keystone:SELECT=100 {{(pid=88551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:08:57.541910 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d30e3d15-5f43-4cf5-ab95-b421178ea3f8 None admin] Validating token access rules against request {{(pid=88551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:08:57.577621 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f030538f-f8ef-4332-8e48-5507bd853458 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '819d41a279e64291acc60de51e1530ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:08:57.578222 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f030538f-f8ef-4332-8e48-5507bd853458 None admin] REQUEST_METHOD: `GET` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:08:57.578497 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f030538f-f8ef-4332-8e48-5507bd853458 None admin] SCRIPT_NAME: `/identity` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:08:57.578801 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f030538f-f8ef-4332-8e48-5507bd853458 None admin] PATH_INFO: `/v3/users` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:08:57.579524 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f030538f-f8ef-4332-8e48-5507bd853458 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=88551) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 19:08:57.579834 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f030538f-f8ef-4332-8e48-5507bd853458 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:08:57.581337 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f030538f-f8ef-4332-8e48-5507bd853458 None admin] RBAC: Authorization granted {{(pid=88551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:08:57.599510 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: [pid: 88551|app: 0|req: 431/875] 10.222.0.26 () {56 vars in 1143 bytes} [Wed Aug 17 19:08:57 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 19:08:57.605889 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4440f6a-ae0a-4b97-955b-7579aa515054 None admin] Authenticating user token {{(pid=88550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:08:57.715076 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4440f6a-ae0a-4b97-955b-7579aa515054 None admin] Validating token access rules against request {{(pid=88550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:08:57.751060 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9454c037-732a-4200-8784-b64417ea297f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '819d41a279e64291acc60de51e1530ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:08:57.751620 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9454c037-732a-4200-8784-b64417ea297f None admin] REQUEST_METHOD: `GET` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:08:57.751905 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9454c037-732a-4200-8784-b64417ea297f None admin] SCRIPT_NAME: `/identity` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:08:57.752178 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9454c037-732a-4200-8784-b64417ea297f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:08:57.813782 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG dbcounter [-] [88550] Writing DB stats keystone:SELECT=100 {{(pid=88550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:08:57.826234 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9454c037-732a-4200-8784-b64417ea297f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:08:57.827736 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9454c037-732a-4200-8784-b64417ea297f None admin] RBAC: Authorization granted {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:08:57.929641 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: [pid: 88550|app: 0|req: 445/876] 10.222.0.26 () {58 vars in 1282 bytes} [Wed Aug 17 19:08:57 2022] GET /identity/v3/auth/tokens => generated 1869 bytes in 324 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 17 19:08:57.936022 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f030538f-f8ef-4332-8e48-5507bd853458 None admin] Authenticating user token {{(pid=88551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:08:58.037268 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f030538f-f8ef-4332-8e48-5507bd853458 None admin] Validating token access rules against request {{(pid=88551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:08:58.047317 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG dbcounter [-] [88551] Writing DB stats keystone:SELECT=100 {{(pid=88551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:08:58.071073 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e367d0b-6f2e-45da-8283-0919a642219d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '819d41a279e64291acc60de51e1530ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:08:58.071680 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e367d0b-6f2e-45da-8283-0919a642219d None admin] REQUEST_METHOD: `GET` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:08:58.071961 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e367d0b-6f2e-45da-8283-0919a642219d None admin] SCRIPT_NAME: `/identity` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:08:58.072229 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e367d0b-6f2e-45da-8283-0919a642219d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:08:58.081853 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e367d0b-6f2e-45da-8283-0919a642219d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:08:58.089083 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e367d0b-6f2e-45da-8283-0919a642219d None admin] RBAC: Authorization granted {{(pid=88551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:08:58.098178 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application [None req-0e367d0b-6f2e-45da-8283-0919a642219d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 19:08:58.098178 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 19:08:58.098178 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 19:08:58.098178 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 19:08:58.098178 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 19:08:58.098178 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 19:08:58.098178 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 19:08:58.098178 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 19:08:58.098178 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 19:08:58.098178 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 19:08:58.098178 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 19:08:58.098178 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 19:08:58.098178 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 17 19:08:58.098178 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 17 19:08:58.098178 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 17 19:08:58.098178 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 17 19:08:58.099358 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 19:08:58.099358 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 19:08:58.099358 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 19:08:58.099358 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 19:08:58.099358 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 19:08:58.099358 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 19:08:58.099358 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 19:08:58.099358 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application with Lock( Aug 17 19:08:58.099358 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 19:08:58.099358 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application return self._enter() Aug 17 19:08:58.099358 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 19:08:58.099358 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 19:08:58.099358 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 19:08:58.099358 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application return self.creator() Aug 17 19:08:58.099358 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 19:08:58.099358 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application created_value = creator( Aug 17 19:08:58.099358 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 17 19:08:58.100543 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 17 19:08:58.100543 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 19:08:58.100543 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application Aug 17 19:08:58.100543 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: [pid: 88551|app: 0|req: 432/877] 10.222.0.26 () {56 vars in 1108 bytes} [Wed Aug 17 19:08:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 19:08:58.105727 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9454c037-732a-4200-8784-b64417ea297f None admin] Authenticating user token {{(pid=88550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:08:58.197145 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG dbcounter [-] [88550] Writing DB stats keystone:SELECT=100 {{(pid=88550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:08:58.211426 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9454c037-732a-4200-8784-b64417ea297f None admin] Validating token access rules against request {{(pid=88550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:08:58.245845 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92e5f98e-3c71-4fa7-912c-c32a268c2a76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '819d41a279e64291acc60de51e1530ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:08:58.246438 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e5f98e-3c71-4fa7-912c-c32a268c2a76 None admin] REQUEST_METHOD: `GET` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:08:58.246749 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e5f98e-3c71-4fa7-912c-c32a268c2a76 None admin] SCRIPT_NAME: `/identity` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:08:58.247024 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e5f98e-3c71-4fa7-912c-c32a268c2a76 None admin] PATH_INFO: `/v3/domains` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:08:58.247695 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92e5f98e-3c71-4fa7-912c-c32a268c2a76 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88550) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 19:08:58.248028 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92e5f98e-3c71-4fa7-912c-c32a268c2a76 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:08:58.249646 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92e5f98e-3c71-4fa7-912c-c32a268c2a76 None admin] RBAC: Authorization granted {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:08:58.260658 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: [pid: 88550|app: 0|req: 446/878] 10.222.0.26 () {56 vars in 1109 bytes} [Wed Aug 17 19:08:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 19:08:58.266412 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e367d0b-6f2e-45da-8283-0919a642219d None admin] Authenticating user token {{(pid=88551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:08:58.368406 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e367d0b-6f2e-45da-8283-0919a642219d None admin] Validating token access rules against request {{(pid=88551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:08:58.403044 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-167c5488-dc30-45c4-b080-dce80b753181 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '819d41a279e64291acc60de51e1530ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:08:58.403661 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-167c5488-dc30-45c4-b080-dce80b753181 None admin] REQUEST_METHOD: `GET` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:08:58.403942 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-167c5488-dc30-45c4-b080-dce80b753181 None admin] SCRIPT_NAME: `/identity` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:08:58.404216 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-167c5488-dc30-45c4-b080-dce80b753181 None admin] PATH_INFO: `/v3/projects/service` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:08:58.410845 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-167c5488-dc30-45c4-b080-dce80b753181 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:08:58.412269 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-167c5488-dc30-45c4-b080-dce80b753181 None admin] RBAC: Authorization granted {{(pid=88551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:08:58.423191 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application [None req-167c5488-dc30-45c4-b080-dce80b753181 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 17 19:08:58.423191 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 19:08:58.423191 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 19:08:58.423191 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 19:08:58.423191 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 19:08:58.423191 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 19:08:58.423191 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 19:08:58.423191 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 19:08:58.423191 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 19:08:58.423191 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 19:08:58.423191 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 19:08:58.423191 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 19:08:58.423191 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 17 19:08:58.423191 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 17 19:08:58.423191 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 17 19:08:58.424231 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 17 19:08:58.424231 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 19:08:58.424231 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 19:08:58.424231 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 19:08:58.424231 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 19:08:58.424231 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 19:08:58.424231 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 19:08:58.424231 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 19:08:58.424231 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application with Lock( Aug 17 19:08:58.424231 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 19:08:58.424231 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application return self._enter() Aug 17 19:08:58.424231 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 19:08:58.424231 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 19:08:58.424231 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 19:08:58.424231 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application return self.creator() Aug 17 19:08:58.424231 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 19:08:58.424231 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application created_value = creator( Aug 17 19:08:58.425270 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 17 19:08:58.425270 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 17 19:08:58.425270 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 17 19:08:58.425270 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 17 19:08:58.425270 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 17 19:08:58.425270 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 17 19:08:58.425270 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 17 19:08:58.425270 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application Aug 17 19:08:58.425270 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: [pid: 88551|app: 0|req: 433/879] 10.222.0.26 () {56 vars in 1111 bytes} [Wed Aug 17 19:08:58 2022] GET /identity/v3/projects/service => generated 88 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 19:08:58.430284 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92e5f98e-3c71-4fa7-912c-c32a268c2a76 None admin] Authenticating user token {{(pid=88550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:08:58.542390 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92e5f98e-3c71-4fa7-912c-c32a268c2a76 None admin] Validating token access rules against request {{(pid=88550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:08:58.581598 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ace0bf0-859b-46f9-8622-a45029c9a460 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '819d41a279e64291acc60de51e1530ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:08:58.582228 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ace0bf0-859b-46f9-8622-a45029c9a460 None admin] REQUEST_METHOD: `GET` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:08:58.582505 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ace0bf0-859b-46f9-8622-a45029c9a460 None admin] SCRIPT_NAME: `/identity` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:08:58.582822 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ace0bf0-859b-46f9-8622-a45029c9a460 None admin] PATH_INFO: `/v3/projects` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:08:58.583521 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ace0bf0-859b-46f9-8622-a45029c9a460 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88550) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 19:08:58.583834 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ace0bf0-859b-46f9-8622-a45029c9a460 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:08:58.585307 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ace0bf0-859b-46f9-8622-a45029c9a460 None admin] RBAC: Authorization granted {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:08:58.599582 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: [pid: 88550|app: 0|req: 447/880] 10.222.0.26 () {56 vars in 1148 bytes} [Wed Aug 17 19:08:58 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 19:08:58.606091 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-167c5488-dc30-45c4-b080-dce80b753181 None admin] Authenticating user token {{(pid=88551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:08:58.629630 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG dbcounter [-] [88551] Writing DB stats keystone:SELECT=100 {{(pid=88551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:08:58.711782 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-167c5488-dc30-45c4-b080-dce80b753181 None admin] Validating token access rules against request {{(pid=88551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:08:58.746730 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eff7f20d-5638-4f46-b44c-f8df93098c47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '819d41a279e64291acc60de51e1530ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:08:58.747319 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff7f20d-5638-4f46-b44c-f8df93098c47 None admin] REQUEST_METHOD: `GET` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:08:58.747592 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff7f20d-5638-4f46-b44c-f8df93098c47 None admin] SCRIPT_NAME: `/identity` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:08:58.747859 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff7f20d-5638-4f46-b44c-f8df93098c47 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:08:58.748573 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eff7f20d-5638-4f46-b44c-f8df93098c47 None admin] RBAC: Adding query filter params (role.id=204f62ae18174b60a2e3f5d4f28ea326, scope.project.id=4bbf6c5abd684d899d09a08b0847d81c, user.id=6478a47e33024d1abc99f078dbc30787) {{(pid=88551) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 19:08:58.748873 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eff7f20d-5638-4f46-b44c-f8df93098c47 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:08:58.750330 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eff7f20d-5638-4f46-b44c-f8df93098c47 None admin] RBAC: Authorization granted {{(pid=88551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:08:58.755858 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: [pid: 88551|app: 0|req: 434/881] 10.222.0.26 () {56 vars in 1374 bytes} [Wed Aug 17 19:08:58 2022] GET /identity/v3/role_assignments?user.id=6478a47e33024d1abc99f078dbc30787&scope.project.id=4bbf6c5abd684d899d09a08b0847d81c&role.id=204f62ae18174b60a2e3f5d4f28ea326 => generated 259 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 19:09:00.893866 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d20616-f48e-44da-8d19-f24d1294c676 None None] REQUEST_METHOD: `GET` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:09:00.894405 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d20616-f48e-44da-8d19-f24d1294c676 None None] SCRIPT_NAME: `/identity` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:09:00.894405 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d20616-f48e-44da-8d19-f24d1294c676 None None] PATH_INFO: `/` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:09:00.895803 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: [pid: 88550|app: 0|req: 448/882] 10.222.0.26 () {54 vars in 927 bytes} [Wed Aug 17 19:09:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 19:09:00.900979 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-026777b1-a08d-4f42-b5df-b3f983c04da5 None None] REQUEST_METHOD: `POST` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:09:00.901430 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-026777b1-a08d-4f42-b5df-b3f983c04da5 None None] SCRIPT_NAME: `/identity` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:09:00.901523 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-026777b1-a08d-4f42-b5df-b3f983c04da5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:09:00.919996 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.auth.core [None req-026777b1-a08d-4f42-b5df-b3f983c04da5 None None] MFA Rules not processed for user `819d41a279e64291acc60de51e1530ae`. Rule list: `[]` (Enabled: `True`). {{(pid=88551) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 19:09:00.921392 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.common.fernet_utils [None req-026777b1-a08d-4f42-b5df-b3f983c04da5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:09:00.991321 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: [pid: 88551|app: 0|req: 435/883] 10.222.0.26 () {58 vars in 1024 bytes} [Wed Aug 17 19:09:00 2022] POST /identity/v3/auth/tokens => generated 1869 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 17 19:09:01.315387 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5d20616-f48e-44da-8d19-f24d1294c676 None None] Authenticating user token {{(pid=88550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:09:01.326290 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG dbcounter [-] [88550] Writing DB stats keystone:SELECT=100 {{(pid=88550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:09:01.437253 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5d20616-f48e-44da-8d19-f24d1294c676 None None] Validating token access rules against request {{(pid=88550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:09:01.472325 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-279b5b78-9d27-4601-bc31-d24d43884de4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '819d41a279e64291acc60de51e1530ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:09:01.472944 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-279b5b78-9d27-4601-bc31-d24d43884de4 None admin] REQUEST_METHOD: `GET` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:09:01.473223 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-279b5b78-9d27-4601-bc31-d24d43884de4 None admin] SCRIPT_NAME: `/identity` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:09:01.473497 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-279b5b78-9d27-4601-bc31-d24d43884de4 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:09:01.486847 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-279b5b78-9d27-4601-bc31-d24d43884de4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 17 19:09:01.491811 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application [None req-279b5b78-9d27-4601-bc31-d24d43884de4 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 17 19:09:01.491811 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 19:09:01.491811 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 19:09:01.491811 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 19:09:01.491811 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 19:09:01.491811 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 19:09:01.491811 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 19:09:01.491811 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 19:09:01.491811 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 19:09:01.491811 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 19:09:01.491811 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 19:09:01.491811 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 19:09:01.491811 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 17 19:09:01.491811 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 17 19:09:01.491811 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 17 19:09:01.491811 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 17 19:09:01.492901 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 17 19:09:01.492901 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 17 19:09:01.492901 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 17 19:09:01.492901 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 17 19:09:01.492901 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 19:09:01.492901 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 19:09:01.492901 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 19:09:01.492901 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 19:09:01.492901 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 19:09:01.492901 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 19:09:01.492901 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 19:09:01.492901 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application with Lock( Aug 17 19:09:01.492901 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 19:09:01.492901 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return self._enter() Aug 17 19:09:01.492901 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 19:09:01.492901 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 19:09:01.493818 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 19:09:01.493818 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return self.creator() Aug 17 19:09:01.493818 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 19:09:01.493818 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application created_value = creator( Aug 17 19:09:01.493818 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 17 19:09:01.493818 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 17 19:09:01.493818 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 17 19:09:01.493818 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 17 19:09:01.493818 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 17 19:09:01.493818 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 17 19:09:01.493818 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 17 19:09:01.493818 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application Aug 17 19:09:01.493818 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: [pid: 88550|app: 0|req: 449/884] 10.222.0.26 () {56 vars in 1096 bytes} [Wed Aug 17 19:09:01 2022] GET /identity/v3/roles/admin => generated 83 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 19:09:01.499273 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-026777b1-a08d-4f42-b5df-b3f983c04da5 None None] Authenticating user token {{(pid=88551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:09:01.514857 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG dbcounter [-] [88551] Writing DB stats keystone:SELECT=100 {{(pid=88551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:09:01.602133 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-026777b1-a08d-4f42-b5df-b3f983c04da5 None None] Validating token access rules against request {{(pid=88551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:09:01.643093 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50ba03e6-28e9-409a-9d72-87e3ea7a726e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '819d41a279e64291acc60de51e1530ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:09:01.643705 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ba03e6-28e9-409a-9d72-87e3ea7a726e None admin] REQUEST_METHOD: `GET` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:09:01.644009 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ba03e6-28e9-409a-9d72-87e3ea7a726e None admin] SCRIPT_NAME: `/identity` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:09:01.644305 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ba03e6-28e9-409a-9d72-87e3ea7a726e None admin] PATH_INFO: `/v3/roles` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:09:01.645948 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50ba03e6-28e9-409a-9d72-87e3ea7a726e None admin] RBAC: Adding query filter params (name=admin) {{(pid=88551) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 19:09:01.646253 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50ba03e6-28e9-409a-9d72-87e3ea7a726e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:09:01.647635 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50ba03e6-28e9-409a-9d72-87e3ea7a726e None admin] RBAC: Authorization granted {{(pid=88551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:09:01.656438 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: [pid: 88551|app: 0|req: 436/885] 10.222.0.26 () {56 vars in 1099 bytes} [Wed Aug 17 19:09:01 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 19:09:01.662414 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-279b5b78-9d27-4601-bc31-d24d43884de4 None admin] Authenticating user token {{(pid=88550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:09:01.732913 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG dbcounter [-] [88550] Writing DB stats keystone:SELECT=100 {{(pid=88550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:09:01.768301 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-279b5b78-9d27-4601-bc31-d24d43884de4 None admin] Validating token access rules against request {{(pid=88550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:09:01.802246 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c50ec400-6b33-4a85-850c-af09fcd68f63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '819d41a279e64291acc60de51e1530ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:09:01.802899 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c50ec400-6b33-4a85-850c-af09fcd68f63 None admin] REQUEST_METHOD: `GET` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:09:01.803177 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c50ec400-6b33-4a85-850c-af09fcd68f63 None admin] SCRIPT_NAME: `/identity` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:09:01.803452 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c50ec400-6b33-4a85-850c-af09fcd68f63 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:09:01.814419 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c50ec400-6b33-4a85-850c-af09fcd68f63 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:09:01.815897 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c50ec400-6b33-4a85-850c-af09fcd68f63 None admin] RBAC: Authorization granted {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:09:01.830952 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application [None req-c50ec400-6b33-4a85-850c-af09fcd68f63 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 19:09:01.830952 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 19:09:01.830952 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 19:09:01.830952 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 19:09:01.830952 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 19:09:01.830952 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 19:09:01.830952 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 19:09:01.830952 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 19:09:01.830952 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 19:09:01.830952 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 19:09:01.830952 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 19:09:01.830952 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 19:09:01.830952 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 17 19:09:01.830952 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 17 19:09:01.830952 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 17 19:09:01.830952 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 17 19:09:01.838339 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 19:09:01.838339 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 19:09:01.838339 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 19:09:01.838339 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 19:09:01.838339 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 19:09:01.838339 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 19:09:01.838339 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 19:09:01.838339 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application with Lock( Aug 17 19:09:01.838339 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 19:09:01.838339 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return self._enter() Aug 17 19:09:01.838339 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 19:09:01.838339 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 19:09:01.838339 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 19:09:01.838339 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return self.creator() Aug 17 19:09:01.838339 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 19:09:01.838339 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application created_value = creator( Aug 17 19:09:01.838339 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 17 19:09:01.839518 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 17 19:09:01.839518 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 19:09:01.839518 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application Aug 17 19:09:01.839518 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: [pid: 88550|app: 0|req: 450/886] 10.222.0.26 () {56 vars in 1108 bytes} [Wed Aug 17 19:09:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 19:09:01.839810 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50ba03e6-28e9-409a-9d72-87e3ea7a726e None admin] Authenticating user token {{(pid=88551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:09:01.916162 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG dbcounter [-] [88551] Writing DB stats keystone:SELECT=100 {{(pid=88551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:09:01.940436 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50ba03e6-28e9-409a-9d72-87e3ea7a726e None admin] Validating token access rules against request {{(pid=88551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:09:01.978730 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3edfb449-9186-402b-9d21-a9bdb73fef8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '819d41a279e64291acc60de51e1530ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:09:01.982295 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3edfb449-9186-402b-9d21-a9bdb73fef8a None admin] REQUEST_METHOD: `GET` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:09:01.982295 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3edfb449-9186-402b-9d21-a9bdb73fef8a None admin] SCRIPT_NAME: `/identity` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:09:01.982295 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3edfb449-9186-402b-9d21-a9bdb73fef8a None admin] PATH_INFO: `/v3/domains` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:09:01.982295 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3edfb449-9186-402b-9d21-a9bdb73fef8a None admin] RBAC: Adding query filter params (name=Default) {{(pid=88551) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 19:09:01.982295 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3edfb449-9186-402b-9d21-a9bdb73fef8a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:09:01.982295 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3edfb449-9186-402b-9d21-a9bdb73fef8a None admin] RBAC: Authorization granted {{(pid=88551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:09:01.996033 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: [pid: 88551|app: 0|req: 437/887] 10.222.0.26 () {56 vars in 1109 bytes} [Wed Aug 17 19:09:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 19:09:02.001958 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c50ec400-6b33-4a85-850c-af09fcd68f63 None admin] Authenticating user token {{(pid=88550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:09:02.102404 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c50ec400-6b33-4a85-850c-af09fcd68f63 None admin] Validating token access rules against request {{(pid=88550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:09:02.124496 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG dbcounter [-] [88550] Writing DB stats keystone:SELECT=100 {{(pid=88550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:09:02.138054 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edd08c43-741c-4fdd-9392-770fb0950d4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '819d41a279e64291acc60de51e1530ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:09:02.138715 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd08c43-741c-4fdd-9392-770fb0950d4f None admin] REQUEST_METHOD: `GET` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:09:02.138996 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd08c43-741c-4fdd-9392-770fb0950d4f None admin] SCRIPT_NAME: `/identity` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:09:02.139267 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd08c43-741c-4fdd-9392-770fb0950d4f None admin] PATH_INFO: `/v3/users/placement` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:09:02.147161 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edd08c43-741c-4fdd-9392-770fb0950d4f None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:09:02.148611 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edd08c43-741c-4fdd-9392-770fb0950d4f None admin] RBAC: Authorization granted {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:09:02.160597 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application [None req-edd08c43-741c-4fdd-9392-770fb0950d4f None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 17 19:09:02.160597 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 19:09:02.160597 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 19:09:02.160597 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 19:09:02.160597 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 19:09:02.160597 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 19:09:02.160597 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 19:09:02.160597 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 19:09:02.160597 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 19:09:02.160597 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 19:09:02.160597 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 19:09:02.160597 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 19:09:02.160597 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 17 19:09:02.160597 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 17 19:09:02.160597 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 17 19:09:02.160597 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 17 19:09:02.161718 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 19:09:02.161718 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 19:09:02.161718 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 17 19:09:02.161718 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 17 19:09:02.161718 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 17 19:09:02.161718 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 17 19:09:02.161718 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 19:09:02.161718 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 19:09:02.161718 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 19:09:02.161718 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 19:09:02.161718 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 19:09:02.161718 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application with Lock( Aug 17 19:09:02.161718 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 19:09:02.161718 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return self._enter() Aug 17 19:09:02.161718 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 19:09:02.161718 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 19:09:02.161718 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 19:09:02.161718 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return self.creator() Aug 17 19:09:02.162847 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 19:09:02.162847 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application created_value = creator( Aug 17 19:09:02.162847 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 17 19:09:02.162847 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 17 19:09:02.162847 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 17 19:09:02.162847 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 17 19:09:02.162847 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 17 19:09:02.162847 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 17 19:09:02.162847 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 17 19:09:02.162847 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application Aug 17 19:09:02.162847 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: [pid: 88550|app: 0|req: 451/888] 10.222.0.26 () {56 vars in 1108 bytes} [Wed Aug 17 19:09:02 2022] GET /identity/v3/users/placement => generated 87 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 19:09:02.168815 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3edfb449-9186-402b-9d21-a9bdb73fef8a None admin] Authenticating user token {{(pid=88551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:09:02.270923 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3edfb449-9186-402b-9d21-a9bdb73fef8a None admin] Validating token access rules against request {{(pid=88551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:09:02.307668 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6d1fda9-0822-4523-836c-b4fa6f51b565 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '819d41a279e64291acc60de51e1530ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:09:02.308293 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d1fda9-0822-4523-836c-b4fa6f51b565 None admin] REQUEST_METHOD: `GET` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:09:02.308569 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d1fda9-0822-4523-836c-b4fa6f51b565 None admin] SCRIPT_NAME: `/identity` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:09:02.308839 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d1fda9-0822-4523-836c-b4fa6f51b565 None admin] PATH_INFO: `/v3/users` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:09:02.309581 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6d1fda9-0822-4523-836c-b4fa6f51b565 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=88551) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 19:09:02.309870 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6d1fda9-0822-4523-836c-b4fa6f51b565 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:09:02.311347 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6d1fda9-0822-4523-836c-b4fa6f51b565 None admin] RBAC: Authorization granted {{(pid=88551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:09:02.314164 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG dbcounter [-] [88551] Writing DB stats keystone:SELECT=100 {{(pid=88551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:09:02.329498 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: [pid: 88551|app: 0|req: 438/889] 10.222.0.26 () {56 vars in 1143 bytes} [Wed Aug 17 19:09:02 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 19:09:02.335643 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edd08c43-741c-4fdd-9392-770fb0950d4f None admin] Authenticating user token {{(pid=88550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:09:02.442096 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edd08c43-741c-4fdd-9392-770fb0950d4f None admin] Validating token access rules against request {{(pid=88550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:09:02.475788 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a647fc74-2c18-4c32-bf10-088bb9654018 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '819d41a279e64291acc60de51e1530ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:09:02.476413 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a647fc74-2c18-4c32-bf10-088bb9654018 None admin] REQUEST_METHOD: `GET` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:09:02.476695 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a647fc74-2c18-4c32-bf10-088bb9654018 None admin] SCRIPT_NAME: `/identity` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:09:02.476971 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a647fc74-2c18-4c32-bf10-088bb9654018 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:09:02.488382 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a647fc74-2c18-4c32-bf10-088bb9654018 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:09:02.489869 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a647fc74-2c18-4c32-bf10-088bb9654018 None admin] RBAC: Authorization granted {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:09:02.504230 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application [None req-a647fc74-2c18-4c32-bf10-088bb9654018 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 19:09:02.504230 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 19:09:02.504230 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 19:09:02.504230 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 19:09:02.504230 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 19:09:02.504230 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 19:09:02.504230 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 19:09:02.504230 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 19:09:02.504230 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 19:09:02.504230 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 19:09:02.504230 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 19:09:02.504230 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 19:09:02.504230 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 17 19:09:02.504230 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 17 19:09:02.504230 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 17 19:09:02.504230 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 17 19:09:02.510261 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 19:09:02.510261 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 19:09:02.510261 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 19:09:02.510261 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 19:09:02.510261 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 19:09:02.510261 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 19:09:02.510261 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 19:09:02.510261 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application with Lock( Aug 17 19:09:02.510261 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 19:09:02.510261 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return self._enter() Aug 17 19:09:02.510261 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 19:09:02.510261 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 19:09:02.510261 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 19:09:02.510261 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return self.creator() Aug 17 19:09:02.510261 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 19:09:02.510261 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application created_value = creator( Aug 17 19:09:02.510261 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 17 19:09:02.511402 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 17 19:09:02.511402 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 19:09:02.511402 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application Aug 17 19:09:02.511402 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: [pid: 88550|app: 0|req: 452/890] 10.222.0.26 () {56 vars in 1108 bytes} [Wed Aug 17 19:09:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 19:09:02.512125 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6d1fda9-0822-4523-836c-b4fa6f51b565 None admin] Authenticating user token {{(pid=88551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:09:02.625719 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6d1fda9-0822-4523-836c-b4fa6f51b565 None admin] Validating token access rules against request {{(pid=88551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:09:02.660448 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-706380d0-7184-4668-bd75-70facf9ea31e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '819d41a279e64291acc60de51e1530ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:09:02.661048 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-706380d0-7184-4668-bd75-70facf9ea31e None admin] REQUEST_METHOD: `GET` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:09:02.661325 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-706380d0-7184-4668-bd75-70facf9ea31e None admin] SCRIPT_NAME: `/identity` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:09:02.661594 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-706380d0-7184-4668-bd75-70facf9ea31e None admin] PATH_INFO: `/v3/domains` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:09:02.662236 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-706380d0-7184-4668-bd75-70facf9ea31e None admin] RBAC: Adding query filter params (name=Default) {{(pid=88551) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 19:09:02.662556 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-706380d0-7184-4668-bd75-70facf9ea31e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:09:02.663910 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-706380d0-7184-4668-bd75-70facf9ea31e None admin] RBAC: Authorization granted {{(pid=88551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:09:02.676619 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: [pid: 88551|app: 0|req: 439/891] 10.222.0.26 () {56 vars in 1109 bytes} [Wed Aug 17 19:09:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 19:09:02.682881 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a647fc74-2c18-4c32-bf10-088bb9654018 None admin] Authenticating user token {{(pid=88550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:09:02.715966 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG dbcounter [-] [88550] Writing DB stats keystone:SELECT=100 {{(pid=88550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:09:02.782895 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a647fc74-2c18-4c32-bf10-088bb9654018 None admin] Validating token access rules against request {{(pid=88550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:09:02.823723 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a7d3710-f72e-475e-b99f-f32d9b9315bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '819d41a279e64291acc60de51e1530ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:09:02.824750 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a7d3710-f72e-475e-b99f-f32d9b9315bb None admin] REQUEST_METHOD: `GET` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:09:02.825240 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a7d3710-f72e-475e-b99f-f32d9b9315bb None admin] SCRIPT_NAME: `/identity` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:09:02.825709 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a7d3710-f72e-475e-b99f-f32d9b9315bb None admin] PATH_INFO: `/v3/projects/service` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:09:02.833018 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a7d3710-f72e-475e-b99f-f32d9b9315bb None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:09:02.834462 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a7d3710-f72e-475e-b99f-f32d9b9315bb None admin] RBAC: Authorization granted {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:09:02.846402 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application [None req-9a7d3710-f72e-475e-b99f-f32d9b9315bb None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 17 19:09:02.846402 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 19:09:02.846402 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 19:09:02.846402 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 19:09:02.846402 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 19:09:02.846402 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 19:09:02.846402 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 19:09:02.846402 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 19:09:02.846402 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 19:09:02.846402 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 19:09:02.846402 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 19:09:02.846402 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 19:09:02.846402 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 17 19:09:02.846402 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 17 19:09:02.846402 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 17 19:09:02.847533 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 17 19:09:02.847533 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 19:09:02.847533 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 19:09:02.847533 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 19:09:02.847533 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 19:09:02.847533 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 19:09:02.847533 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 19:09:02.847533 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 19:09:02.847533 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application with Lock( Aug 17 19:09:02.847533 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 19:09:02.847533 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return self._enter() Aug 17 19:09:02.847533 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 19:09:02.847533 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 19:09:02.847533 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 19:09:02.847533 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return self.creator() Aug 17 19:09:02.847533 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 19:09:02.847533 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application created_value = creator( Aug 17 19:09:02.848580 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 17 19:09:02.848580 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 17 19:09:02.848580 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 17 19:09:02.848580 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 17 19:09:02.848580 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 17 19:09:02.848580 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 17 19:09:02.848580 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 17 19:09:02.848580 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application Aug 17 19:09:02.848580 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: [pid: 88550|app: 0|req: 453/892] 10.222.0.26 () {56 vars in 1111 bytes} [Wed Aug 17 19:09:02 2022] GET /identity/v3/projects/service => generated 88 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 17 19:09:02.854096 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-706380d0-7184-4668-bd75-70facf9ea31e None admin] Authenticating user token {{(pid=88551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:09:02.910944 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG dbcounter [-] [88551] Writing DB stats keystone:SELECT=100 {{(pid=88551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:09:02.956404 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-706380d0-7184-4668-bd75-70facf9ea31e None admin] Validating token access rules against request {{(pid=88551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:09:02.990666 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d5ae1d9-85bb-4f0b-a101-68f88f982889 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '819d41a279e64291acc60de51e1530ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:09:02.991273 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d5ae1d9-85bb-4f0b-a101-68f88f982889 None admin] REQUEST_METHOD: `GET` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:09:02.991552 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d5ae1d9-85bb-4f0b-a101-68f88f982889 None admin] SCRIPT_NAME: `/identity` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:09:02.991824 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d5ae1d9-85bb-4f0b-a101-68f88f982889 None admin] PATH_INFO: `/v3/projects` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:09:02.992509 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d5ae1d9-85bb-4f0b-a101-68f88f982889 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88551) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 19:09:02.992816 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d5ae1d9-85bb-4f0b-a101-68f88f982889 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:09:02.994378 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d5ae1d9-85bb-4f0b-a101-68f88f982889 None admin] RBAC: Authorization granted {{(pid=88551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:09:03.006299 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: [pid: 88551|app: 0|req: 440/893] 10.222.0.26 () {56 vars in 1148 bytes} [Wed Aug 17 19:09:02 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 19:09:03.012936 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a7d3710-f72e-475e-b99f-f32d9b9315bb None admin] Authenticating user token {{(pid=88550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:09:03.109578 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG dbcounter [-] [88550] Writing DB stats keystone:SELECT=100 {{(pid=88550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:09:03.118903 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a7d3710-f72e-475e-b99f-f32d9b9315bb None admin] Validating token access rules against request {{(pid=88550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:09:03.153342 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76e8252c-5625-4a06-85f6-8c773b7e863b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '819d41a279e64291acc60de51e1530ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:09:03.153989 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e8252c-5625-4a06-85f6-8c773b7e863b None admin] REQUEST_METHOD: `PUT` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:09:03.154265 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e8252c-5625-4a06-85f6-8c773b7e863b None admin] SCRIPT_NAME: `/identity` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:09:03.154567 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e8252c-5625-4a06-85f6-8c773b7e863b None admin] PATH_INFO: `/v3/projects/4bbf6c5abd684d899d09a08b0847d81c/users/6478a47e33024d1abc99f078dbc30787/roles/204f62ae18174b60a2e3f5d4f28ea326` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:09:03.156454 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76e8252c-5625-4a06-85f6-8c773b7e863b None admin] RBAC: Authorizing `identity:create_grant(project_id=4bbf6c5abd684d899d09a08b0847d81c, user_id=6478a47e33024d1abc99f078dbc30787, role_id=204f62ae18174b60a2e3f5d4f28ea326)` {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:09:03.157912 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76e8252c-5625-4a06-85f6-8c773b7e863b None admin] RBAC: Authorization granted {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:09:03.221810 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: [pid: 88550|app: 0|req: 454/894] 10.222.0.26 () {58 vars in 1439 bytes} [Wed Aug 17 19:09:03 2022] PUT /identity/v3/projects/4bbf6c5abd684d899d09a08b0847d81c/users/6478a47e33024d1abc99f078dbc30787/roles/204f62ae18174b60a2e3f5d4f28ea326 => generated 0 bytes in 209 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 19:09:05.390416 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f018c04c-6d01-4ff2-aaf3-46efe8e869f3 None None] REQUEST_METHOD: `GET` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:09:05.391120 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f018c04c-6d01-4ff2-aaf3-46efe8e869f3 None None] SCRIPT_NAME: `/identity` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:09:05.391120 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f018c04c-6d01-4ff2-aaf3-46efe8e869f3 None None] PATH_INFO: `/` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:09:05.392315 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: [pid: 88551|app: 0|req: 441/895] 10.222.0.26 () {54 vars in 927 bytes} [Wed Aug 17 19:09:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 19:09:05.397567 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba84f891-fc26-47a8-b4a9-6d814d090398 None None] REQUEST_METHOD: `POST` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:09:05.398079 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba84f891-fc26-47a8-b4a9-6d814d090398 None None] SCRIPT_NAME: `/identity` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:09:05.398232 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba84f891-fc26-47a8-b4a9-6d814d090398 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:09:05.417406 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.auth.core [None req-ba84f891-fc26-47a8-b4a9-6d814d090398 None None] MFA Rules not processed for user `819d41a279e64291acc60de51e1530ae`. Rule list: `[]` (Enabled: `True`). {{(pid=88550) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 19:09:05.418650 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.common.fernet_utils [None req-ba84f891-fc26-47a8-b4a9-6d814d090398 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:09:05.486809 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: [pid: 88550|app: 0|req: 455/896] 10.222.0.26 () {58 vars in 1024 bytes} [Wed Aug 17 19:09:05 2022] POST /identity/v3/auth/tokens => generated 1869 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 17 19:09:05.815498 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f018c04c-6d01-4ff2-aaf3-46efe8e869f3 None None] Authenticating user token {{(pid=88551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:09:05.930645 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f018c04c-6d01-4ff2-aaf3-46efe8e869f3 None None] Validating token access rules against request {{(pid=88551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:09:05.947696 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG dbcounter [-] [88551] Writing DB stats keystone:SELECT=100 {{(pid=88551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:09:05.968335 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a57a4261-dfd7-4c48-977e-6bee7bbfb69c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '819d41a279e64291acc60de51e1530ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:09:05.969039 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a57a4261-dfd7-4c48-977e-6bee7bbfb69c None admin] REQUEST_METHOD: `GET` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:09:05.971021 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a57a4261-dfd7-4c48-977e-6bee7bbfb69c None admin] SCRIPT_NAME: `/identity` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:09:05.971021 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a57a4261-dfd7-4c48-977e-6bee7bbfb69c None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:09:05.980002 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a57a4261-dfd7-4c48-977e-6bee7bbfb69c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 17 19:09:05.984681 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application [None req-a57a4261-dfd7-4c48-977e-6bee7bbfb69c None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 17 19:09:05.984681 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 19:09:05.984681 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 19:09:05.984681 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 19:09:05.984681 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 19:09:05.984681 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 19:09:05.984681 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 19:09:05.984681 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 19:09:05.984681 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 19:09:05.984681 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 19:09:05.984681 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 19:09:05.984681 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 19:09:05.984681 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 17 19:09:05.984681 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 17 19:09:05.984681 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 17 19:09:05.984681 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 17 19:09:05.986031 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 17 19:09:05.986031 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 17 19:09:05.986031 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 17 19:09:05.986031 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 17 19:09:05.986031 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 19:09:05.986031 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 19:09:05.986031 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 19:09:05.986031 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 19:09:05.986031 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 19:09:05.986031 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 19:09:05.986031 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 19:09:05.986031 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application with Lock( Aug 17 19:09:05.986031 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 19:09:05.986031 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application return self._enter() Aug 17 19:09:05.986031 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 19:09:05.986031 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 19:09:05.987376 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 19:09:05.987376 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application return self.creator() Aug 17 19:09:05.987376 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 19:09:05.987376 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application created_value = creator( Aug 17 19:09:05.987376 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 17 19:09:05.987376 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 17 19:09:05.987376 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 17 19:09:05.987376 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 17 19:09:05.987376 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 17 19:09:05.987376 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 17 19:09:05.987376 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 17 19:09:05.987376 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application Aug 17 19:09:05.987376 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: [pid: 88551|app: 0|req: 442/897] 10.222.0.26 () {56 vars in 1096 bytes} [Wed Aug 17 19:09:05 2022] GET /identity/v3/roles/admin => generated 83 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 19:09:05.991974 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba84f891-fc26-47a8-b4a9-6d814d090398 None None] Authenticating user token {{(pid=88550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:09:06.091179 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG dbcounter [-] [88550] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:09:06.109440 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba84f891-fc26-47a8-b4a9-6d814d090398 None None] Validating token access rules against request {{(pid=88550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:09:06.152962 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faa857a0-1cca-4843-9183-d6bf9763a92d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '819d41a279e64291acc60de51e1530ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:09:06.153593 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa857a0-1cca-4843-9183-d6bf9763a92d None admin] REQUEST_METHOD: `GET` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:09:06.153868 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa857a0-1cca-4843-9183-d6bf9763a92d None admin] SCRIPT_NAME: `/identity` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:09:06.154145 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa857a0-1cca-4843-9183-d6bf9763a92d None admin] PATH_INFO: `/v3/roles` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:09:06.154889 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faa857a0-1cca-4843-9183-d6bf9763a92d None admin] RBAC: Adding query filter params (name=admin) {{(pid=88550) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 19:09:06.155191 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faa857a0-1cca-4843-9183-d6bf9763a92d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:09:06.156587 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faa857a0-1cca-4843-9183-d6bf9763a92d None admin] RBAC: Authorization granted {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:09:06.165310 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: [pid: 88550|app: 0|req: 456/898] 10.222.0.26 () {56 vars in 1099 bytes} [Wed Aug 17 19:09:05 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 19:09:06.171541 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a57a4261-dfd7-4c48-977e-6bee7bbfb69c None admin] Authenticating user token {{(pid=88551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:09:06.279859 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a57a4261-dfd7-4c48-977e-6bee7bbfb69c None admin] Validating token access rules against request {{(pid=88551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:09:06.317497 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58afb1fa-53d2-489f-bc34-61381019339d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '819d41a279e64291acc60de51e1530ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:09:06.318114 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58afb1fa-53d2-489f-bc34-61381019339d None admin] REQUEST_METHOD: `GET` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:09:06.318393 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58afb1fa-53d2-489f-bc34-61381019339d None admin] SCRIPT_NAME: `/identity` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:09:06.318707 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58afb1fa-53d2-489f-bc34-61381019339d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:09:06.329810 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58afb1fa-53d2-489f-bc34-61381019339d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:09:06.331273 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58afb1fa-53d2-489f-bc34-61381019339d None admin] RBAC: Authorization granted {{(pid=88551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:09:06.348477 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application [None req-58afb1fa-53d2-489f-bc34-61381019339d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 19:09:06.348477 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 19:09:06.348477 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 19:09:06.348477 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 19:09:06.348477 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 19:09:06.348477 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 19:09:06.348477 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 19:09:06.348477 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 19:09:06.348477 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 19:09:06.348477 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 19:09:06.348477 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 19:09:06.348477 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 19:09:06.348477 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 17 19:09:06.348477 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 17 19:09:06.348477 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 17 19:09:06.348477 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 17 19:09:06.349878 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 19:09:06.349878 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 19:09:06.349878 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 19:09:06.349878 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 19:09:06.349878 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 19:09:06.349878 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 19:09:06.349878 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 19:09:06.349878 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application with Lock( Aug 17 19:09:06.349878 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 19:09:06.349878 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application return self._enter() Aug 17 19:09:06.349878 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 19:09:06.349878 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 19:09:06.349878 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 19:09:06.349878 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application return self.creator() Aug 17 19:09:06.349878 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 19:09:06.349878 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application created_value = creator( Aug 17 19:09:06.349878 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 17 19:09:06.351202 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 17 19:09:06.351202 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 19:09:06.351202 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application Aug 17 19:09:06.351202 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: [pid: 88551|app: 0|req: 443/899] 10.222.0.26 () {56 vars in 1108 bytes} [Wed Aug 17 19:09:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 17 19:09:06.355422 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faa857a0-1cca-4843-9183-d6bf9763a92d None admin] Authenticating user token {{(pid=88550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:09:06.460114 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faa857a0-1cca-4843-9183-d6bf9763a92d None admin] Validating token access rules against request {{(pid=88550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:09:06.504577 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4326d527-8eaf-41f2-be5c-575d73232223 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '819d41a279e64291acc60de51e1530ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:09:06.505193 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4326d527-8eaf-41f2-be5c-575d73232223 None admin] REQUEST_METHOD: `GET` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:09:06.505469 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4326d527-8eaf-41f2-be5c-575d73232223 None admin] SCRIPT_NAME: `/identity` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:09:06.505740 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4326d527-8eaf-41f2-be5c-575d73232223 None admin] PATH_INFO: `/v3/domains` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:09:06.506396 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4326d527-8eaf-41f2-be5c-575d73232223 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88550) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 19:09:06.506891 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4326d527-8eaf-41f2-be5c-575d73232223 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:09:06.508124 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4326d527-8eaf-41f2-be5c-575d73232223 None admin] RBAC: Authorization granted {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:09:06.537909 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: [pid: 88550|app: 0|req: 457/900] 10.222.0.26 () {56 vars in 1109 bytes} [Wed Aug 17 19:09:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 19:09:06.544278 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58afb1fa-53d2-489f-bc34-61381019339d None admin] Authenticating user token {{(pid=88551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:09:06.582381 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG dbcounter [-] [88551] Writing DB stats keystone:SELECT=100 {{(pid=88551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:09:06.663391 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58afb1fa-53d2-489f-bc34-61381019339d None admin] Validating token access rules against request {{(pid=88551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:09:06.708745 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d62dec2-cc44-4c02-b33c-89f1a22916da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '819d41a279e64291acc60de51e1530ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:09:06.709395 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d62dec2-cc44-4c02-b33c-89f1a22916da None admin] REQUEST_METHOD: `GET` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:09:06.709673 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d62dec2-cc44-4c02-b33c-89f1a22916da None admin] SCRIPT_NAME: `/identity` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:09:06.709965 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d62dec2-cc44-4c02-b33c-89f1a22916da None admin] PATH_INFO: `/v3/users/placement` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:09:06.719163 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d62dec2-cc44-4c02-b33c-89f1a22916da None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=88551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:09:06.720638 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d62dec2-cc44-4c02-b33c-89f1a22916da None admin] RBAC: Authorization granted {{(pid=88551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:09:06.734913 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application [None req-7d62dec2-cc44-4c02-b33c-89f1a22916da None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 17 19:09:06.734913 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 19:09:06.734913 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 19:09:06.734913 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 19:09:06.734913 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 19:09:06.734913 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 19:09:06.734913 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 19:09:06.734913 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 19:09:06.734913 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 19:09:06.734913 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 19:09:06.734913 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 19:09:06.734913 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 19:09:06.734913 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 17 19:09:06.734913 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 17 19:09:06.734913 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 17 19:09:06.734913 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 17 19:09:06.739964 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 19:09:06.739964 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 19:09:06.739964 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 17 19:09:06.739964 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 17 19:09:06.739964 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 17 19:09:06.739964 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 17 19:09:06.739964 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 19:09:06.739964 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 19:09:06.739964 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 19:09:06.739964 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 19:09:06.739964 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 19:09:06.739964 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application with Lock( Aug 17 19:09:06.739964 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 19:09:06.739964 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application return self._enter() Aug 17 19:09:06.739964 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 19:09:06.739964 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 19:09:06.739964 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 19:09:06.739964 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application return self.creator() Aug 17 19:09:06.740925 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 19:09:06.740925 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application created_value = creator( Aug 17 19:09:06.740925 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 17 19:09:06.740925 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 17 19:09:06.740925 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 17 19:09:06.740925 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 17 19:09:06.740925 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 17 19:09:06.740925 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 17 19:09:06.740925 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 17 19:09:06.740925 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application Aug 17 19:09:06.740925 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: [pid: 88551|app: 0|req: 444/901] 10.222.0.26 () {56 vars in 1108 bytes} [Wed Aug 17 19:09:06 2022] GET /identity/v3/users/placement => generated 87 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 19:09:06.743713 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4326d527-8eaf-41f2-be5c-575d73232223 None admin] Authenticating user token {{(pid=88550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:09:06.749544 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG dbcounter [-] [88550] Writing DB stats keystone:SELECT=100 {{(pid=88550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:09:06.852480 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4326d527-8eaf-41f2-be5c-575d73232223 None admin] Validating token access rules against request {{(pid=88550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:09:06.888003 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3daba33-f648-4086-86aa-364ece71d395 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '819d41a279e64291acc60de51e1530ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:09:06.888608 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3daba33-f648-4086-86aa-364ece71d395 None admin] REQUEST_METHOD: `GET` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:09:06.888890 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3daba33-f648-4086-86aa-364ece71d395 None admin] SCRIPT_NAME: `/identity` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:09:06.889164 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3daba33-f648-4086-86aa-364ece71d395 None admin] PATH_INFO: `/v3/users` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:09:06.889922 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3daba33-f648-4086-86aa-364ece71d395 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=88550) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 19:09:06.890231 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3daba33-f648-4086-86aa-364ece71d395 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:09:06.891715 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3daba33-f648-4086-86aa-364ece71d395 None admin] RBAC: Authorization granted {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:09:06.911054 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: [pid: 88550|app: 0|req: 458/902] 10.222.0.26 () {56 vars in 1143 bytes} [Wed Aug 17 19:09:06 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 19:09:06.918810 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d62dec2-cc44-4c02-b33c-89f1a22916da None admin] Authenticating user token {{(pid=88551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:09:07.014404 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG dbcounter [-] [88551] Writing DB stats keystone:SELECT=100 {{(pid=88551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:09:07.029239 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d62dec2-cc44-4c02-b33c-89f1a22916da None admin] Validating token access rules against request {{(pid=88551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:09:07.062655 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df2407ec-6e7a-45ae-90c1-be69d2d77dbd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '819d41a279e64291acc60de51e1530ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:09:07.063519 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df2407ec-6e7a-45ae-90c1-be69d2d77dbd None admin] REQUEST_METHOD: `GET` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:09:07.063803 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df2407ec-6e7a-45ae-90c1-be69d2d77dbd None admin] SCRIPT_NAME: `/identity` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:09:07.064078 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df2407ec-6e7a-45ae-90c1-be69d2d77dbd None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:09:07.135523 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df2407ec-6e7a-45ae-90c1-be69d2d77dbd None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:09:07.136965 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df2407ec-6e7a-45ae-90c1-be69d2d77dbd None admin] RBAC: Authorization granted {{(pid=88551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:09:07.222805 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG dbcounter [-] [88551] Writing DB stats keystone:SELECT=100 {{(pid=88551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:09:07.239018 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: [pid: 88551|app: 0|req: 445/903] 10.222.0.26 () {58 vars in 1282 bytes} [Wed Aug 17 19:09:06 2022] GET /identity/v3/auth/tokens => generated 1869 bytes in 321 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 17 19:09:07.245129 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3daba33-f648-4086-86aa-364ece71d395 None admin] Authenticating user token {{(pid=88550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:09:07.308730 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG dbcounter [-] [88550] Writing DB stats keystone:SELECT=100 {{(pid=88550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:09:07.347346 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3daba33-f648-4086-86aa-364ece71d395 None admin] Validating token access rules against request {{(pid=88550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:09:07.381132 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57444c8f-372a-4665-bc28-fffb2469a06e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '819d41a279e64291acc60de51e1530ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:09:07.381745 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57444c8f-372a-4665-bc28-fffb2469a06e None admin] REQUEST_METHOD: `GET` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:09:07.382019 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57444c8f-372a-4665-bc28-fffb2469a06e None admin] SCRIPT_NAME: `/identity` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:09:07.382285 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57444c8f-372a-4665-bc28-fffb2469a06e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:09:07.392529 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57444c8f-372a-4665-bc28-fffb2469a06e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:09:07.393962 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57444c8f-372a-4665-bc28-fffb2469a06e None admin] RBAC: Authorization granted {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:09:07.408664 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application [None req-57444c8f-372a-4665-bc28-fffb2469a06e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 19:09:07.408664 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 19:09:07.408664 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 19:09:07.408664 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 19:09:07.408664 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 19:09:07.408664 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 19:09:07.408664 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 19:09:07.408664 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 19:09:07.408664 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 19:09:07.408664 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 19:09:07.408664 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 19:09:07.408664 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 19:09:07.408664 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 17 19:09:07.408664 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 17 19:09:07.408664 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 17 19:09:07.408664 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 17 19:09:07.410171 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 19:09:07.410171 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 19:09:07.410171 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 19:09:07.410171 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 19:09:07.410171 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 19:09:07.410171 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 19:09:07.410171 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 19:09:07.410171 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application with Lock( Aug 17 19:09:07.410171 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 19:09:07.410171 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return self._enter() Aug 17 19:09:07.410171 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 19:09:07.410171 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 19:09:07.410171 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 19:09:07.410171 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return self.creator() Aug 17 19:09:07.410171 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 19:09:07.410171 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application created_value = creator( Aug 17 19:09:07.410171 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 17 19:09:07.411336 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 17 19:09:07.411336 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 19:09:07.411336 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application Aug 17 19:09:07.411336 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: [pid: 88550|app: 0|req: 459/904] 10.222.0.26 () {56 vars in 1108 bytes} [Wed Aug 17 19:09:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 19:09:07.415485 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df2407ec-6e7a-45ae-90c1-be69d2d77dbd None admin] Authenticating user token {{(pid=88551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:09:07.515243 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df2407ec-6e7a-45ae-90c1-be69d2d77dbd None admin] Validating token access rules against request {{(pid=88551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:09:07.549447 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f9bc2ac-61e8-4c66-9f6e-46381e41f5b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '819d41a279e64291acc60de51e1530ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:09:07.550097 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f9bc2ac-61e8-4c66-9f6e-46381e41f5b4 None admin] REQUEST_METHOD: `GET` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:09:07.550312 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f9bc2ac-61e8-4c66-9f6e-46381e41f5b4 None admin] SCRIPT_NAME: `/identity` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:09:07.550614 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f9bc2ac-61e8-4c66-9f6e-46381e41f5b4 None admin] PATH_INFO: `/v3/domains` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:09:07.551290 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f9bc2ac-61e8-4c66-9f6e-46381e41f5b4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88551) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 19:09:07.551600 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f9bc2ac-61e8-4c66-9f6e-46381e41f5b4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:09:07.552947 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f9bc2ac-61e8-4c66-9f6e-46381e41f5b4 None admin] RBAC: Authorization granted {{(pid=88551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:09:07.564619 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: [pid: 88551|app: 0|req: 446/905] 10.222.0.26 () {56 vars in 1109 bytes} [Wed Aug 17 19:09:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 19:09:07.570284 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57444c8f-372a-4665-bc28-fffb2469a06e None admin] Authenticating user token {{(pid=88550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:09:07.682826 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57444c8f-372a-4665-bc28-fffb2469a06e None admin] Validating token access rules against request {{(pid=88550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:09:07.698401 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG dbcounter [-] [88550] Writing DB stats keystone:SELECT=100 {{(pid=88550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:09:07.718772 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ade7061a-99e6-4742-be45-f0156af99b83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '819d41a279e64291acc60de51e1530ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:09:07.719392 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade7061a-99e6-4742-be45-f0156af99b83 None admin] REQUEST_METHOD: `GET` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:09:07.719670 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade7061a-99e6-4742-be45-f0156af99b83 None admin] SCRIPT_NAME: `/identity` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:09:07.719940 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade7061a-99e6-4742-be45-f0156af99b83 None admin] PATH_INFO: `/v3/projects/service` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:09:07.726896 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ade7061a-99e6-4742-be45-f0156af99b83 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:09:07.728343 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ade7061a-99e6-4742-be45-f0156af99b83 None admin] RBAC: Authorization granted {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:09:07.739758 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application [None req-ade7061a-99e6-4742-be45-f0156af99b83 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 17 19:09:07.739758 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 19:09:07.739758 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 19:09:07.739758 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 19:09:07.739758 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 19:09:07.739758 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 19:09:07.739758 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 19:09:07.739758 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 19:09:07.739758 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 19:09:07.739758 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 19:09:07.739758 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 19:09:07.739758 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 19:09:07.739758 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 17 19:09:07.739758 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 17 19:09:07.739758 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 17 19:09:07.740874 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 17 19:09:07.740874 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 19:09:07.740874 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 19:09:07.740874 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 19:09:07.740874 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 19:09:07.740874 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 19:09:07.740874 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 19:09:07.740874 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 19:09:07.740874 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application with Lock( Aug 17 19:09:07.740874 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 19:09:07.740874 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return self._enter() Aug 17 19:09:07.740874 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 19:09:07.740874 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 19:09:07.740874 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 19:09:07.740874 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return self.creator() Aug 17 19:09:07.740874 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 19:09:07.740874 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application created_value = creator( Aug 17 19:09:07.742130 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 17 19:09:07.742130 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 17 19:09:07.742130 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 17 19:09:07.742130 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 17 19:09:07.742130 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 17 19:09:07.742130 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 17 19:09:07.742130 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 17 19:09:07.742130 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: ERROR keystone.server.flask.application Aug 17 19:09:07.742130 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: [pid: 88550|app: 0|req: 460/906] 10.222.0.26 () {56 vars in 1111 bytes} [Wed Aug 17 19:09:07 2022] GET /identity/v3/projects/service => generated 88 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 19:09:07.747376 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f9bc2ac-61e8-4c66-9f6e-46381e41f5b4 None admin] Authenticating user token {{(pid=88551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:09:07.796138 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG dbcounter [-] [88551] Writing DB stats keystone:SELECT=100 {{(pid=88551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:09:07.850802 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f9bc2ac-61e8-4c66-9f6e-46381e41f5b4 None admin] Validating token access rules against request {{(pid=88551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:09:07.885596 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b98e86a2-1885-4841-8f8e-7a6725f5454e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '819d41a279e64291acc60de51e1530ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:09:07.886192 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b98e86a2-1885-4841-8f8e-7a6725f5454e None admin] REQUEST_METHOD: `GET` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:09:07.886467 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b98e86a2-1885-4841-8f8e-7a6725f5454e None admin] SCRIPT_NAME: `/identity` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:09:07.886767 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b98e86a2-1885-4841-8f8e-7a6725f5454e None admin] PATH_INFO: `/v3/projects` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:09:07.887453 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b98e86a2-1885-4841-8f8e-7a6725f5454e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88551) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 19:09:07.887755 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b98e86a2-1885-4841-8f8e-7a6725f5454e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:09:07.889164 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b98e86a2-1885-4841-8f8e-7a6725f5454e None admin] RBAC: Authorization granted {{(pid=88551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:09:07.901159 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: [pid: 88551|app: 0|req: 447/907] 10.222.0.26 () {56 vars in 1148 bytes} [Wed Aug 17 19:09:07 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 19:09:07.907502 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ade7061a-99e6-4742-be45-f0156af99b83 None admin] Authenticating user token {{(pid=88550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:09:08.008507 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ade7061a-99e6-4742-be45-f0156af99b83 None admin] Validating token access rules against request {{(pid=88550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:09:08.042936 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd975429-6cb3-45be-a95d-e879fbac4222 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '819d41a279e64291acc60de51e1530ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:09:08.043563 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd975429-6cb3-45be-a95d-e879fbac4222 None admin] REQUEST_METHOD: `GET` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:09:08.043843 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd975429-6cb3-45be-a95d-e879fbac4222 None admin] SCRIPT_NAME: `/identity` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:09:08.044115 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd975429-6cb3-45be-a95d-e879fbac4222 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:09:08.044833 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd975429-6cb3-45be-a95d-e879fbac4222 None admin] RBAC: Adding query filter params (role.id=204f62ae18174b60a2e3f5d4f28ea326, scope.project.id=4bbf6c5abd684d899d09a08b0847d81c, user.id=6478a47e33024d1abc99f078dbc30787) {{(pid=88550) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 19:09:08.045142 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd975429-6cb3-45be-a95d-e879fbac4222 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:09:08.046634 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd975429-6cb3-45be-a95d-e879fbac4222 None admin] RBAC: Authorization granted {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:09:08.052225 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: [pid: 88550|app: 0|req: 461/908] 10.222.0.26 () {56 vars in 1374 bytes} [Wed Aug 17 19:09:07 2022] GET /identity/v3/role_assignments?user.id=6478a47e33024d1abc99f078dbc30787&scope.project.id=4bbf6c5abd684d899d09a08b0847d81c&role.id=204f62ae18174b60a2e3f5d4f28ea326 => generated 608 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 19:09:10.280617 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a7dfe0-b444-4ab2-89e3-e4f9269778e6 None None] REQUEST_METHOD: `GET` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:09:10.281176 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a7dfe0-b444-4ab2-89e3-e4f9269778e6 None None] SCRIPT_NAME: `/identity` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:09:10.281176 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a7dfe0-b444-4ab2-89e3-e4f9269778e6 None None] PATH_INFO: `/` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:09:10.282524 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: [pid: 88551|app: 0|req: 448/909] 10.222.0.26 () {54 vars in 927 bytes} [Wed Aug 17 19:09:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 19:09:10.287963 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-029c15ca-a986-4303-969c-bcfb2d0c626d None None] REQUEST_METHOD: `POST` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:09:10.288403 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-029c15ca-a986-4303-969c-bcfb2d0c626d None None] SCRIPT_NAME: `/identity` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:09:10.288502 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-029c15ca-a986-4303-969c-bcfb2d0c626d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:09:10.306909 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.auth.core [None req-029c15ca-a986-4303-969c-bcfb2d0c626d None None] MFA Rules not processed for user `819d41a279e64291acc60de51e1530ae`. Rule list: `[]` (Enabled: `True`). {{(pid=88550) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 19:09:10.308100 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.common.fernet_utils [None req-029c15ca-a986-4303-969c-bcfb2d0c626d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:09:10.338242 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG dbcounter [-] [88550] Writing DB stats keystone:SELECT=100 {{(pid=88550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:09:10.376801 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: [pid: 88550|app: 0|req: 462/910] 10.222.0.26 () {58 vars in 1024 bytes} [Wed Aug 17 19:09:10 2022] POST /identity/v3/auth/tokens => generated 1869 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 17 19:09:10.703820 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03a7dfe0-b444-4ab2-89e3-e4f9269778e6 None None] Authenticating user token {{(pid=88551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:09:10.813890 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03a7dfe0-b444-4ab2-89e3-e4f9269778e6 None None] Validating token access rules against request {{(pid=88551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:09:10.821686 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG dbcounter [-] [88551] Writing DB stats keystone:SELECT=100 {{(pid=88551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:09:10.847733 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-370b2836-96ef-4eec-af11-92bf18e0d74e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '819d41a279e64291acc60de51e1530ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:09:10.848344 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-370b2836-96ef-4eec-af11-92bf18e0d74e None admin] REQUEST_METHOD: `GET` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:09:10.848620 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-370b2836-96ef-4eec-af11-92bf18e0d74e None admin] SCRIPT_NAME: `/identity` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:09:10.848891 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-370b2836-96ef-4eec-af11-92bf18e0d74e None admin] PATH_INFO: `/v3/services/placement` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:09:10.849489 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-370b2836-96ef-4eec-af11-92bf18e0d74e None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=88551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:09:10.850878 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-370b2836-96ef-4eec-af11-92bf18e0d74e None admin] RBAC: Authorization granted {{(pid=88551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:09:10.860151 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application [None req-370b2836-96ef-4eec-af11-92bf18e0d74e None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Aug 17 19:09:10.860151 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 19:09:10.860151 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 17 19:09:10.860151 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 17 19:09:10.860151 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 17 19:09:10.860151 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 17 19:09:10.860151 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 17 19:09:10.860151 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 17 19:09:10.860151 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 17 19:09:10.860151 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application Aug 17 19:09:10.860151 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 17 19:09:10.860151 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application Aug 17 19:09:10.860151 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 19:09:10.860151 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 19:09:10.860151 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 19:09:10.860151 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 19:09:10.860151 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 19:09:10.861970 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 19:09:10.861970 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 19:09:10.861970 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 19:09:10.861970 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 19:09:10.861970 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 19:09:10.861970 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 19:09:10.861970 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 17 19:09:10.861970 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 17 19:09:10.861970 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 17 19:09:10.861970 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 17 19:09:10.861970 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 19:09:10.861970 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 19:09:10.861970 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 19:09:10.861970 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 19:09:10.861970 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 19:09:10.861970 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 19:09:10.862872 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 19:09:10.862872 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application with Lock( Aug 17 19:09:10.862872 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 19:09:10.862872 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application return self._enter() Aug 17 19:09:10.862872 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 19:09:10.862872 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 19:09:10.862872 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 19:09:10.862872 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application return self.creator() Aug 17 19:09:10.862872 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 19:09:10.862872 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application created_value = creator( Aug 17 19:09:10.862872 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 17 19:09:10.862872 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 17 19:09:10.862872 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 17 19:09:10.862872 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application Aug 17 19:09:10.862872 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: [pid: 88551|app: 0|req: 449/911] 10.222.0.26 () {56 vars in 1117 bytes} [Wed Aug 17 19:09:10 2022] GET /identity/v3/services/placement => generated 90 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 19:09:10.867565 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-029c15ca-a986-4303-969c-bcfb2d0c626d None None] Authenticating user token {{(pid=88550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:09:10.965209 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-029c15ca-a986-4303-969c-bcfb2d0c626d None None] Validating token access rules against request {{(pid=88550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:09:10.998401 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-481332ba-9c8c-40f4-bf5b-14e334db396d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '819d41a279e64291acc60de51e1530ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:09:10.999025 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-481332ba-9c8c-40f4-bf5b-14e334db396d None admin] REQUEST_METHOD: `GET` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:09:10.999305 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-481332ba-9c8c-40f4-bf5b-14e334db396d None admin] SCRIPT_NAME: `/identity` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:09:10.999577 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-481332ba-9c8c-40f4-bf5b-14e334db396d None admin] PATH_INFO: `/v3/services` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:09:11.000203 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-481332ba-9c8c-40f4-bf5b-14e334db396d None admin] RBAC: Adding query filter params (name=placement) {{(pid=88550) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 19:09:11.000505 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-481332ba-9c8c-40f4-bf5b-14e334db396d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:09:11.001864 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-481332ba-9c8c-40f4-bf5b-14e334db396d None admin] RBAC: Authorization granted {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:09:11.006641 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: [pid: 88550|app: 0|req: 463/912] 10.222.0.26 () {56 vars in 1116 bytes} [Wed Aug 17 19:09:10 2022] GET /identity/v3/services?name=placement => generated 126 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 19:09:11.012546 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-370b2836-96ef-4eec-af11-92bf18e0d74e None admin] Authenticating user token {{(pid=88551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:09:11.113542 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-370b2836-96ef-4eec-af11-92bf18e0d74e None admin] Validating token access rules against request {{(pid=88551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:09:11.147353 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eedfe264-a223-495c-a20c-475b91f2ff0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '819d41a279e64291acc60de51e1530ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:09:11.147945 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eedfe264-a223-495c-a20c-475b91f2ff0a None admin] REQUEST_METHOD: `GET` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:09:11.148228 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eedfe264-a223-495c-a20c-475b91f2ff0a None admin] SCRIPT_NAME: `/identity` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:09:11.148546 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eedfe264-a223-495c-a20c-475b91f2ff0a None admin] PATH_INFO: `/v3/services` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:09:11.149173 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eedfe264-a223-495c-a20c-475b91f2ff0a None admin] RBAC: Adding query filter params (type=placement) {{(pid=88551) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 19:09:11.149477 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eedfe264-a223-495c-a20c-475b91f2ff0a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:09:11.151457 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eedfe264-a223-495c-a20c-475b91f2ff0a None admin] RBAC: Authorization granted {{(pid=88551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:09:11.156033 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: [pid: 88551|app: 0|req: 450/913] 10.222.0.26 () {56 vars in 1116 bytes} [Wed Aug 17 19:09:11 2022] GET /identity/v3/services?type=placement => generated 126 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 19:09:13.377034 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e044fd82-b4f5-48ad-be7b-95139af378af None None] REQUEST_METHOD: `GET` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:09:13.377572 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e044fd82-b4f5-48ad-be7b-95139af378af None None] SCRIPT_NAME: `/identity` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:09:13.377697 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e044fd82-b4f5-48ad-be7b-95139af378af None None] PATH_INFO: `/` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:09:13.378980 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: [pid: 88550|app: 0|req: 464/914] 10.222.0.26 () {54 vars in 927 bytes} [Wed Aug 17 19:09:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 19:09:13.384386 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c02354-a584-48a7-b328-b7996387544b None None] REQUEST_METHOD: `POST` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:09:13.386677 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c02354-a584-48a7-b328-b7996387544b None None] SCRIPT_NAME: `/identity` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:09:13.386677 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c02354-a584-48a7-b328-b7996387544b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:09:13.403540 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.auth.core [None req-73c02354-a584-48a7-b328-b7996387544b None None] MFA Rules not processed for user `819d41a279e64291acc60de51e1530ae`. Rule list: `[]` (Enabled: `True`). {{(pid=88551) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 19:09:13.404787 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.common.fernet_utils [None req-73c02354-a584-48a7-b328-b7996387544b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:09:13.434324 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG dbcounter [-] [88551] Writing DB stats keystone:SELECT=100 {{(pid=88551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:09:13.474809 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: [pid: 88551|app: 0|req: 451/915] 10.222.0.26 () {58 vars in 1024 bytes} [Wed Aug 17 19:09:13 2022] POST /identity/v3/auth/tokens => generated 1869 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 17 19:09:13.804374 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e044fd82-b4f5-48ad-be7b-95139af378af None None] Authenticating user token {{(pid=88550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:09:13.834846 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG dbcounter [-] [88550] Writing DB stats keystone:SELECT=100 {{(pid=88550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:09:13.905388 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e044fd82-b4f5-48ad-be7b-95139af378af None None] Validating token access rules against request {{(pid=88550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:09:13.941865 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a93e2478-325b-43e2-8321-0f8c9b4cc233 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '819d41a279e64291acc60de51e1530ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:09:13.942770 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a93e2478-325b-43e2-8321-0f8c9b4cc233 None admin] REQUEST_METHOD: `POST` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:09:13.943053 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a93e2478-325b-43e2-8321-0f8c9b4cc233 None admin] SCRIPT_NAME: `/identity` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:09:13.943323 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a93e2478-325b-43e2-8321-0f8c9b4cc233 None admin] PATH_INFO: `/v3/services` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:09:13.943972 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a93e2478-325b-43e2-8321-0f8c9b4cc233 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:09:13.945736 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a93e2478-325b-43e2-8321-0f8c9b4cc233 None admin] RBAC: Authorization granted {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:09:14.033164 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: [pid: 88550|app: 0|req: 465/916] 10.222.0.26 () {60 vars in 1141 bytes} [Wed Aug 17 19:09:13 2022] POST /identity/v3/services => generated 246 bytes in 229 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 19:09:16.217330 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b51d0b59-e99b-4a44-9061-7246cd0469fe None None] REQUEST_METHOD: `GET` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:09:16.217837 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b51d0b59-e99b-4a44-9061-7246cd0469fe None None] SCRIPT_NAME: `/identity` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:09:16.217837 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b51d0b59-e99b-4a44-9061-7246cd0469fe None None] PATH_INFO: `/` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:09:16.219166 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: [pid: 88551|app: 0|req: 452/917] 10.222.0.26 () {54 vars in 927 bytes} [Wed Aug 17 19:09:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 19:09:16.224437 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25893f83-e6d5-4f10-a30b-1a7c93f30010 None None] REQUEST_METHOD: `POST` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:09:16.224868 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25893f83-e6d5-4f10-a30b-1a7c93f30010 None None] SCRIPT_NAME: `/identity` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:09:16.224998 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25893f83-e6d5-4f10-a30b-1a7c93f30010 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:09:16.243293 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.auth.core [None req-25893f83-e6d5-4f10-a30b-1a7c93f30010 None None] MFA Rules not processed for user `819d41a279e64291acc60de51e1530ae`. Rule list: `[]` (Enabled: `True`). {{(pid=88550) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 19:09:16.244571 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.common.fernet_utils [None req-25893f83-e6d5-4f10-a30b-1a7c93f30010 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:09:16.321488 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: [pid: 88550|app: 0|req: 466/918] 10.222.0.26 () {58 vars in 1024 bytes} [Wed Aug 17 19:09:16 2022] POST /identity/v3/auth/tokens => generated 1972 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 17 19:09:16.647449 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b51d0b59-e99b-4a44-9061-7246cd0469fe None None] Authenticating user token {{(pid=88551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:09:16.749999 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b51d0b59-e99b-4a44-9061-7246cd0469fe None None] Validating token access rules against request {{(pid=88551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:09:16.784067 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f361d7e3-896d-48f5-9e78-0e12a74f8259 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '819d41a279e64291acc60de51e1530ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:09:16.784660 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f361d7e3-896d-48f5-9e78-0e12a74f8259 None admin] REQUEST_METHOD: `GET` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:09:16.785021 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f361d7e3-896d-48f5-9e78-0e12a74f8259 None admin] SCRIPT_NAME: `/identity` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:09:16.785293 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f361d7e3-896d-48f5-9e78-0e12a74f8259 None admin] PATH_INFO: `/v3/services/placement` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:09:16.785869 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f361d7e3-896d-48f5-9e78-0e12a74f8259 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=88551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:09:16.787408 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f361d7e3-896d-48f5-9e78-0e12a74f8259 None admin] RBAC: Authorization granted {{(pid=88551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:09:16.796372 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application [None req-f361d7e3-896d-48f5-9e78-0e12a74f8259 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Aug 17 19:09:16.796372 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 19:09:16.796372 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 17 19:09:16.796372 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 17 19:09:16.796372 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 17 19:09:16.796372 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 17 19:09:16.796372 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 17 19:09:16.796372 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 17 19:09:16.796372 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 17 19:09:16.796372 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application Aug 17 19:09:16.796372 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 17 19:09:16.796372 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application Aug 17 19:09:16.796372 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 19:09:16.796372 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 19:09:16.796372 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 19:09:16.796372 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 19:09:16.796372 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 19:09:16.797593 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 19:09:16.797593 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 19:09:16.797593 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 19:09:16.797593 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 19:09:16.797593 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 19:09:16.797593 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 19:09:16.797593 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 17 19:09:16.797593 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 17 19:09:16.797593 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 17 19:09:16.797593 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 17 19:09:16.797593 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 19:09:16.797593 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 19:09:16.797593 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 19:09:16.797593 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 19:09:16.797593 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 19:09:16.797593 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 19:09:16.798675 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 19:09:16.798675 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application with Lock( Aug 17 19:09:16.798675 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 19:09:16.798675 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application return self._enter() Aug 17 19:09:16.798675 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 19:09:16.798675 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 19:09:16.798675 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 19:09:16.798675 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application return self.creator() Aug 17 19:09:16.798675 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 19:09:16.798675 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application created_value = creator( Aug 17 19:09:16.798675 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 17 19:09:16.798675 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 17 19:09:16.798675 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 17 19:09:16.798675 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application Aug 17 19:09:16.798675 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: [pid: 88551|app: 0|req: 453/919] 10.222.0.26 () {56 vars in 1117 bytes} [Wed Aug 17 19:09:16 2022] GET /identity/v3/services/placement => generated 90 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 19:09:16.803996 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25893f83-e6d5-4f10-a30b-1a7c93f30010 None None] Authenticating user token {{(pid=88550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:09:16.823741 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG dbcounter [-] [88550] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:09:16.902520 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25893f83-e6d5-4f10-a30b-1a7c93f30010 None None] Validating token access rules against request {{(pid=88550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:09:16.935437 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06a8bdda-d1a6-47aa-846a-7eb18735ea40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '819d41a279e64291acc60de51e1530ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:09:16.936032 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a8bdda-d1a6-47aa-846a-7eb18735ea40 None admin] REQUEST_METHOD: `GET` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:09:16.936312 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a8bdda-d1a6-47aa-846a-7eb18735ea40 None admin] SCRIPT_NAME: `/identity` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:09:16.936585 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a8bdda-d1a6-47aa-846a-7eb18735ea40 None admin] PATH_INFO: `/v3/services` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:09:16.937216 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06a8bdda-d1a6-47aa-846a-7eb18735ea40 None admin] RBAC: Adding query filter params (name=placement) {{(pid=88550) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 19:09:16.937517 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06a8bdda-d1a6-47aa-846a-7eb18735ea40 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:09:16.939187 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06a8bdda-d1a6-47aa-846a-7eb18735ea40 None admin] RBAC: Authorization granted {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:09:16.944232 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: [pid: 88550|app: 0|req: 467/920] 10.222.0.26 () {56 vars in 1116 bytes} [Wed Aug 17 19:09:16 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 19:09:16.950841 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f361d7e3-896d-48f5-9e78-0e12a74f8259 None admin] Authenticating user token {{(pid=88551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:09:16.979444 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG dbcounter [-] [88551] Writing DB stats keystone:SELECT=100 {{(pid=88551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:09:17.050366 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f361d7e3-896d-48f5-9e78-0e12a74f8259 None admin] Validating token access rules against request {{(pid=88551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:09:17.090412 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67c3194b-46d7-4f6d-acb8-a40a0b75bd1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '819d41a279e64291acc60de51e1530ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:09:17.091036 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c3194b-46d7-4f6d-acb8-a40a0b75bd1c None admin] REQUEST_METHOD: `GET` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:09:17.091315 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c3194b-46d7-4f6d-acb8-a40a0b75bd1c None admin] SCRIPT_NAME: `/identity` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:09:17.091585 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c3194b-46d7-4f6d-acb8-a40a0b75bd1c None admin] PATH_INFO: `/v3/endpoints` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:09:17.092286 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67c3194b-46d7-4f6d-acb8-a40a0b75bd1c None admin] RBAC: Adding query filter params (interface=public, service_id=34231db3daa0458a9b93041a3e07939b, region_id=RegionOne) {{(pid=88551) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 19:09:17.092591 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67c3194b-46d7-4f6d-acb8-a40a0b75bd1c None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=88551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:09:17.093938 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67c3194b-46d7-4f6d-acb8-a40a0b75bd1c None admin] RBAC: Authorization granted {{(pid=88551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:09:17.098911 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: [pid: 88551|app: 0|req: 454/921] 10.222.0.26 () {56 vars in 1251 bytes} [Wed Aug 17 19:09:16 2022] GET /identity/v3/endpoints?service_id=34231db3daa0458a9b93041a3e07939b&interface=public®ion_id=RegionOne => generated 194 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 19:09:17.105430 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06a8bdda-d1a6-47aa-846a-7eb18735ea40 None admin] Authenticating user token {{(pid=88550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:09:17.184976 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG dbcounter [-] [88550] Writing DB stats keystone:SELECT=100 {{(pid=88550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:09:17.202999 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06a8bdda-d1a6-47aa-846a-7eb18735ea40 None admin] Validating token access rules against request {{(pid=88550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:09:17.238776 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37401f59-68ff-4f1a-8983-2702f7691b7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '819d41a279e64291acc60de51e1530ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:09:17.239461 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37401f59-68ff-4f1a-8983-2702f7691b7f None admin] REQUEST_METHOD: `GET` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:09:17.239641 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37401f59-68ff-4f1a-8983-2702f7691b7f None admin] SCRIPT_NAME: `/identity` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:09:17.239911 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37401f59-68ff-4f1a-8983-2702f7691b7f None admin] PATH_INFO: `/v3/services` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:09:17.240508 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37401f59-68ff-4f1a-8983-2702f7691b7f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:09:17.241867 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37401f59-68ff-4f1a-8983-2702f7691b7f None admin] RBAC: Authorization granted {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:09:17.249308 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: [pid: 88550|app: 0|req: 468/922] 10.222.0.26 () {56 vars in 1087 bytes} [Wed Aug 17 19:09:17 2022] GET /identity/v3/services => generated 1962 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 19:09:19.448833 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee66e445-a71a-4210-afed-a70856cdb5f3 None None] REQUEST_METHOD: `GET` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:09:19.449397 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee66e445-a71a-4210-afed-a70856cdb5f3 None None] SCRIPT_NAME: `/identity` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:09:19.449397 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee66e445-a71a-4210-afed-a70856cdb5f3 None None] PATH_INFO: `/` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:09:19.450788 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: [pid: 88551|app: 0|req: 455/923] 10.222.0.26 () {54 vars in 927 bytes} [Wed Aug 17 19:09:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 19:09:19.455986 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-485f78fc-7aa6-40b8-872a-d9871584ef7c None None] REQUEST_METHOD: `POST` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:09:19.456385 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-485f78fc-7aa6-40b8-872a-d9871584ef7c None None] SCRIPT_NAME: `/identity` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:09:19.456538 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-485f78fc-7aa6-40b8-872a-d9871584ef7c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:09:19.474922 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.auth.core [None req-485f78fc-7aa6-40b8-872a-d9871584ef7c None None] MFA Rules not processed for user `819d41a279e64291acc60de51e1530ae`. Rule list: `[]` (Enabled: `True`). {{(pid=88550) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 19:09:19.476106 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.common.fernet_utils [None req-485f78fc-7aa6-40b8-872a-d9871584ef7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:09:19.542227 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: [pid: 88550|app: 0|req: 469/924] 10.222.0.26 () {58 vars in 1024 bytes} [Wed Aug 17 19:09:19 2022] POST /identity/v3/auth/tokens => generated 1972 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 17 19:09:19.868969 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee66e445-a71a-4210-afed-a70856cdb5f3 None None] Authenticating user token {{(pid=88551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:09:19.962874 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG dbcounter [-] [88551] Writing DB stats keystone:SELECT=100 {{(pid=88551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:09:19.972330 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee66e445-a71a-4210-afed-a70856cdb5f3 None None] Validating token access rules against request {{(pid=88551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:09:20.005526 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54560c33-ecaf-428b-a7d9-6f51516ab85b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '819d41a279e64291acc60de51e1530ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:09:20.006143 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54560c33-ecaf-428b-a7d9-6f51516ab85b None admin] REQUEST_METHOD: `GET` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:09:20.006420 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54560c33-ecaf-428b-a7d9-6f51516ab85b None admin] SCRIPT_NAME: `/identity` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:09:20.006724 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54560c33-ecaf-428b-a7d9-6f51516ab85b None admin] PATH_INFO: `/v3/services/placement` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:09:20.007310 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54560c33-ecaf-428b-a7d9-6f51516ab85b None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=88551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:09:20.008678 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54560c33-ecaf-428b-a7d9-6f51516ab85b None admin] RBAC: Authorization granted {{(pid=88551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:09:20.018905 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application [None req-54560c33-ecaf-428b-a7d9-6f51516ab85b None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Aug 17 19:09:20.018905 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 19:09:20.018905 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 17 19:09:20.018905 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 17 19:09:20.018905 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 17 19:09:20.018905 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 17 19:09:20.018905 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 17 19:09:20.018905 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 17 19:09:20.018905 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 17 19:09:20.018905 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application Aug 17 19:09:20.018905 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 17 19:09:20.018905 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application Aug 17 19:09:20.018905 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 19:09:20.018905 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 19:09:20.018905 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 19:09:20.018905 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 19:09:20.018905 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 19:09:20.020036 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 19:09:20.020036 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 19:09:20.020036 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 19:09:20.020036 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 19:09:20.020036 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 19:09:20.020036 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 19:09:20.020036 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 17 19:09:20.020036 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 17 19:09:20.020036 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 17 19:09:20.020036 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 17 19:09:20.020036 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 19:09:20.020036 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 19:09:20.020036 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 19:09:20.020036 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 19:09:20.020036 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 19:09:20.020036 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 19:09:20.020973 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 19:09:20.020973 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application with Lock( Aug 17 19:09:20.020973 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 19:09:20.020973 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application return self._enter() Aug 17 19:09:20.020973 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 19:09:20.020973 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 19:09:20.020973 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 19:09:20.020973 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application return self.creator() Aug 17 19:09:20.020973 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 19:09:20.020973 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application created_value = creator( Aug 17 19:09:20.020973 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 17 19:09:20.020973 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 17 19:09:20.020973 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 17 19:09:20.020973 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: ERROR keystone.server.flask.application Aug 17 19:09:20.020973 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: [pid: 88551|app: 0|req: 456/925] 10.222.0.26 () {56 vars in 1117 bytes} [Wed Aug 17 19:09:19 2022] GET /identity/v3/services/placement => generated 90 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 19:09:20.026572 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-485f78fc-7aa6-40b8-872a-d9871584ef7c None None] Authenticating user token {{(pid=88550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:09:20.102280 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG dbcounter [-] [88550] Writing DB stats keystone:SELECT=100 {{(pid=88550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:09:20.125690 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-485f78fc-7aa6-40b8-872a-d9871584ef7c None None] Validating token access rules against request {{(pid=88550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:09:20.157518 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f7ed18f-6651-4063-ba70-91a2601d9a96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '819d41a279e64291acc60de51e1530ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:09:20.158111 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f7ed18f-6651-4063-ba70-91a2601d9a96 None admin] REQUEST_METHOD: `GET` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:09:20.160441 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f7ed18f-6651-4063-ba70-91a2601d9a96 None admin] SCRIPT_NAME: `/identity` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:09:20.160441 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f7ed18f-6651-4063-ba70-91a2601d9a96 None admin] PATH_INFO: `/v3/services` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:09:20.160441 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f7ed18f-6651-4063-ba70-91a2601d9a96 None admin] RBAC: Adding query filter params (name=placement) {{(pid=88550) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 19:09:20.160441 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f7ed18f-6651-4063-ba70-91a2601d9a96 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:09:20.160943 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f7ed18f-6651-4063-ba70-91a2601d9a96 None admin] RBAC: Authorization granted {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:09:20.166394 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: [pid: 88550|app: 0|req: 470/926] 10.222.0.26 () {56 vars in 1116 bytes} [Wed Aug 17 19:09:20 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 19:09:20.172457 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54560c33-ecaf-428b-a7d9-6f51516ab85b None admin] Authenticating user token {{(pid=88551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:09:20.270983 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54560c33-ecaf-428b-a7d9-6f51516ab85b None admin] Validating token access rules against request {{(pid=88551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:09:20.304330 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3e4729f-3436-41cd-bc00-ab04ac13e51b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '819d41a279e64291acc60de51e1530ae', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:09:20.304933 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e4729f-3436-41cd-bc00-ab04ac13e51b None admin] REQUEST_METHOD: `POST` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:09:20.305212 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e4729f-3436-41cd-bc00-ab04ac13e51b None admin] SCRIPT_NAME: `/identity` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:09:20.305483 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e4729f-3436-41cd-bc00-ab04ac13e51b None admin] PATH_INFO: `/v3/endpoints` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:09:20.306820 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3e4729f-3436-41cd-bc00-ab04ac13e51b None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=88551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:09:20.308210 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3e4729f-3436-41cd-bc00-ab04ac13e51b None admin] RBAC: Authorization granted {{(pid=88551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:09:20.398557 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: [pid: 88551|app: 0|req: 457/927] 10.222.0.26 () {60 vars in 1144 bytes} [Wed Aug 17 19:09:20 2022] POST /identity/v3/endpoints => generated 331 bytes in 226 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 17 19:09:30.197938 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG dbcounter [-] [88550] Writing DB stats keystone:SELECT=30 {{(pid=88550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:09:30.393773 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG dbcounter [-] [88551] Writing DB stats keystone:SELECT=93,keystone:INSERT=1 {{(pid=88551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:15:20.932009 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-197f4446-575c-4bce-aaec-95d9a210a0d4 None None] REQUEST_METHOD: `GET` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:15:20.933042 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-197f4446-575c-4bce-aaec-95d9a210a0d4 None None] SCRIPT_NAME: `/identity` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:15:20.933538 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-197f4446-575c-4bce-aaec-95d9a210a0d4 None None] PATH_INFO: `/` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:15:20.935089 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: [pid: 88550|app: 0|req: 471/928] 10.222.0.26 () {54 vars in 927 bytes} [Wed Aug 17 19:15:20 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 19:15:20.943900 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-751d0a6d-4b04-4a29-8453-743fecc8faa4 None None] REQUEST_METHOD: `POST` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:15:20.944442 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-751d0a6d-4b04-4a29-8453-743fecc8faa4 None None] SCRIPT_NAME: `/identity` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:15:20.944528 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-751d0a6d-4b04-4a29-8453-743fecc8faa4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:15:21.097437 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.auth.core [None req-751d0a6d-4b04-4a29-8453-743fecc8faa4 None None] MFA Rules not processed for user `819d41a279e64291acc60de51e1530ae`. Rule list: `[]` (Enabled: `True`). {{(pid=88551) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 19:15:21.100404 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.common.fernet_utils [None req-751d0a6d-4b04-4a29-8453-743fecc8faa4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:15:21.319112 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: [pid: 88551|app: 0|req: 458/929] 10.222.0.26 () {58 vars in 1024 bytes} [Wed Aug 17 19:15:20 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 372 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 19:15:21.691487 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89689d2e-ab6e-4495-92e1-25cb449e6ec8 None None] REQUEST_METHOD: `GET` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:15:21.692058 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89689d2e-ab6e-4495-92e1-25cb449e6ec8 None None] SCRIPT_NAME: `/identity` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:15:21.692539 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89689d2e-ab6e-4495-92e1-25cb449e6ec8 None None] PATH_INFO: `/` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:15:21.694352 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: [pid: 88550|app: 0|req: 472/930] 10.222.0.26 () {54 vars in 965 bytes} [Wed Aug 17 19:15:21 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 19:15:21.701212 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d541d584-7e76-4647-86ef-47c7455150f7 None None] REQUEST_METHOD: `POST` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:15:21.701721 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d541d584-7e76-4647-86ef-47c7455150f7 None None] SCRIPT_NAME: `/identity` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:15:21.702172 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d541d584-7e76-4647-86ef-47c7455150f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:15:21.776095 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.auth.core [None req-d541d584-7e76-4647-86ef-47c7455150f7 None None] MFA Rules not processed for user `8240f6e0b65545708f07e040c09e1490`. Rule list: `[]` (Enabled: `True`). {{(pid=88551) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 19:15:21.777529 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.common.fernet_utils [None req-d541d584-7e76-4647-86ef-47c7455150f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:15:21.829063 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG dbcounter [-] [88551] Writing DB stats keystone:SELECT=100 {{(pid=88551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:15:21.875641 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: [pid: 88551|app: 0|req: 459/931] 10.222.0.26 () {58 vars in 1062 bytes} [Wed Aug 17 19:15:21 2022] POST /identity/v3/auth/tokens => generated 2681 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 17 19:15:21.885029 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89689d2e-ab6e-4495-92e1-25cb449e6ec8 None None] Authenticating user token {{(pid=88550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:15:21.897063 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89689d2e-ab6e-4495-92e1-25cb449e6ec8 None None] Validating token access rules against request {{(pid=88550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:15:21.901471 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1d43e85-c9ea-4852-8003-ea0f7973651c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8240f6e0b65545708f07e040c09e1490', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4bbf6c5abd684d899d09a08b0847d81c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:15:21.902450 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d43e85-c9ea-4852-8003-ea0f7973651c service neutron] REQUEST_METHOD: `GET` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:15:21.902921 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d43e85-c9ea-4852-8003-ea0f7973651c service neutron] SCRIPT_NAME: `/identity` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:15:21.903325 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d43e85-c9ea-4852-8003-ea0f7973651c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:15:21.914402 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1d43e85-c9ea-4852-8003-ea0f7973651c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:15:21.916144 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1d43e85-c9ea-4852-8003-ea0f7973651c service neutron] RBAC: Authorization granted {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:15:21.943341 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: [pid: 88550|app: 0|req: 473/932] 10.222.0.26 () {60 vars in 1365 bytes} [Wed Aug 17 19:15:21 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 59 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 19:15:25.462721 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e628d73-4c55-4f3d-9b34-5d70cae9f831 None None] REQUEST_METHOD: `GET` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:15:25.463282 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e628d73-4c55-4f3d-9b34-5d70cae9f831 None None] SCRIPT_NAME: `/identity` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:15:25.463282 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e628d73-4c55-4f3d-9b34-5d70cae9f831 None None] PATH_INFO: `/` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:15:25.464608 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: [pid: 88551|app: 0|req: 460/933] 10.222.0.26 () {54 vars in 927 bytes} [Wed Aug 17 19:15:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 19:15:25.469914 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5564bab-9f2f-4e66-827b-2c4e3808ad4f None None] REQUEST_METHOD: `POST` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:15:25.470389 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5564bab-9f2f-4e66-827b-2c4e3808ad4f None None] SCRIPT_NAME: `/identity` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:15:25.470469 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5564bab-9f2f-4e66-827b-2c4e3808ad4f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:15:25.492191 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.auth.core [None req-a5564bab-9f2f-4e66-827b-2c4e3808ad4f None None] MFA Rules not processed for user `819d41a279e64291acc60de51e1530ae`. Rule list: `[]` (Enabled: `True`). {{(pid=88550) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 19:15:25.493500 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.common.fernet_utils [None req-a5564bab-9f2f-4e66-827b-2c4e3808ad4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:15:25.501370 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: [pid: 88550|app: 0|req: 474/934] 10.222.0.26 () {58 vars in 1024 bytes} [Wed Aug 17 19:15:25 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 19:15:25.848026 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e628d73-4c55-4f3d-9b34-5d70cae9f831 None None] Authenticating user token {{(pid=88551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:15:25.859841 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e628d73-4c55-4f3d-9b34-5d70cae9f831 None None] Validating token access rules against request {{(pid=88551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:15:25.863426 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52183e01-7007-4fc7-8bec-3389d69cc782 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8240f6e0b65545708f07e040c09e1490', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4bbf6c5abd684d899d09a08b0847d81c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:15:25.864028 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52183e01-7007-4fc7-8bec-3389d69cc782 service neutron] REQUEST_METHOD: `GET` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:15:25.864304 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52183e01-7007-4fc7-8bec-3389d69cc782 service neutron] SCRIPT_NAME: `/identity` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:15:25.864572 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52183e01-7007-4fc7-8bec-3389d69cc782 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:15:25.874519 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52183e01-7007-4fc7-8bec-3389d69cc782 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:15:25.876010 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52183e01-7007-4fc7-8bec-3389d69cc782 service neutron] RBAC: Authorization granted {{(pid=88551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:15:25.886842 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: [pid: 88551|app: 0|req: 461/935] 10.222.0.26 () {60 vars in 1365 bytes} [Wed Aug 17 19:15:25 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 19:15:28.718629 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5695abd-3ade-4f10-bff5-b64776207376 None None] REQUEST_METHOD: `GET` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:15:28.719232 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5695abd-3ade-4f10-bff5-b64776207376 None None] SCRIPT_NAME: `/identity` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:15:28.719232 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5695abd-3ade-4f10-bff5-b64776207376 None None] PATH_INFO: `/` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:15:28.720510 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: [pid: 88550|app: 0|req: 475/936] 10.222.0.26 () {54 vars in 927 bytes} [Wed Aug 17 19:15:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 19:15:28.727121 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b71369fa-9e4f-48cb-b571-df6a673f0310 None None] REQUEST_METHOD: `POST` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:15:28.727620 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b71369fa-9e4f-48cb-b571-df6a673f0310 None None] SCRIPT_NAME: `/identity` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:15:28.727754 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b71369fa-9e4f-48cb-b571-df6a673f0310 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:15:28.797207 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.auth.core [None req-b71369fa-9e4f-48cb-b571-df6a673f0310 None None] MFA Rules not processed for user `42ca546140f547848db6ed420a5044f3`. Rule list: `[]` (Enabled: `True`). {{(pid=88551) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 19:15:28.798470 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.common.fernet_utils [None req-b71369fa-9e4f-48cb-b571-df6a673f0310 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:15:28.896627 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: [pid: 88551|app: 0|req: 462/937] 10.222.0.26 () {58 vars in 1024 bytes} [Wed Aug 17 19:15:28 2022] POST /identity/v3/auth/tokens => generated 2803 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 19:15:29.245196 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5695abd-3ade-4f10-bff5-b64776207376 None None] Authenticating user token {{(pid=88550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:15:29.256053 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5695abd-3ade-4f10-bff5-b64776207376 None None] Validating token access rules against request {{(pid=88550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:15:29.260095 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cca6716-6518-469e-bde5-f24ecd86eb93 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8240f6e0b65545708f07e040c09e1490', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4bbf6c5abd684d899d09a08b0847d81c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:15:29.260691 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cca6716-6518-469e-bde5-f24ecd86eb93 service neutron] REQUEST_METHOD: `GET` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:15:29.260969 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cca6716-6518-469e-bde5-f24ecd86eb93 service neutron] SCRIPT_NAME: `/identity` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:15:29.261248 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cca6716-6518-469e-bde5-f24ecd86eb93 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:15:29.270794 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cca6716-6518-469e-bde5-f24ecd86eb93 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:15:29.272259 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cca6716-6518-469e-bde5-f24ecd86eb93 service neutron] RBAC: Authorization granted {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:15:29.283056 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: [pid: 88550|app: 0|req: 476/938] 10.222.0.26 () {60 vars in 1365 bytes} [Wed Aug 17 19:15:29 2022] GET /identity/v3/auth/tokens => generated 2803 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 17 19:15:32.501068 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd9c87f-1d54-4f5e-ba76-1d98044027df None None] REQUEST_METHOD: `GET` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:15:32.501634 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd9c87f-1d54-4f5e-ba76-1d98044027df None None] SCRIPT_NAME: `/identity` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:15:32.501634 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd9c87f-1d54-4f5e-ba76-1d98044027df None None] PATH_INFO: `/` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:15:32.503007 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: [pid: 88551|app: 0|req: 463/939] 10.222.0.26 () {54 vars in 927 bytes} [Wed Aug 17 19:15:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 19:15:32.509450 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f91d65c-347f-43ad-80b7-de96c2643584 None None] REQUEST_METHOD: `POST` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:15:32.509968 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f91d65c-347f-43ad-80b7-de96c2643584 None None] SCRIPT_NAME: `/identity` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:15:32.510059 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f91d65c-347f-43ad-80b7-de96c2643584 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:15:32.529650 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.auth.core [None req-8f91d65c-347f-43ad-80b7-de96c2643584 None None] MFA Rules not processed for user `819d41a279e64291acc60de51e1530ae`. Rule list: `[]` (Enabled: `True`). {{(pid=88550) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 19:15:32.535398 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.common.fernet_utils [None req-8f91d65c-347f-43ad-80b7-de96c2643584 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:15:32.597093 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: [pid: 88550|app: 0|req: 477/940] 10.222.0.26 () {58 vars in 1024 bytes} [Wed Aug 17 19:15:32 2022] POST /identity/v3/auth/tokens => generated 2798 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 19:15:32.940519 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fd9c87f-1d54-4f5e-ba76-1d98044027df None None] Authenticating user token {{(pid=88551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:15:32.951379 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fd9c87f-1d54-4f5e-ba76-1d98044027df None None] Validating token access rules against request {{(pid=88551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:15:32.954993 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36f0f476-281b-42d0-80ed-c56cc6bb0d61 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8240f6e0b65545708f07e040c09e1490', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4bbf6c5abd684d899d09a08b0847d81c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:15:32.955586 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f0f476-281b-42d0-80ed-c56cc6bb0d61 service neutron] REQUEST_METHOD: `GET` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:15:32.955860 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f0f476-281b-42d0-80ed-c56cc6bb0d61 service neutron] SCRIPT_NAME: `/identity` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:15:32.956130 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f0f476-281b-42d0-80ed-c56cc6bb0d61 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:15:32.966290 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36f0f476-281b-42d0-80ed-c56cc6bb0d61 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:15:32.968473 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36f0f476-281b-42d0-80ed-c56cc6bb0d61 service neutron] RBAC: Authorization granted {{(pid=88551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:15:32.979120 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: [pid: 88551|app: 0|req: 464/941] 10.222.0.26 () {60 vars in 1365 bytes} [Wed Aug 17 19:15:32 2022] GET /identity/v3/auth/tokens => generated 2798 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 19:15:36.392390 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de552e8-dcaa-4744-9f98-b7c6c68d3952 None None] REQUEST_METHOD: `GET` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:15:36.392916 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de552e8-dcaa-4744-9f98-b7c6c68d3952 None None] SCRIPT_NAME: `/identity` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:15:36.392916 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de552e8-dcaa-4744-9f98-b7c6c68d3952 None None] PATH_INFO: `/` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:15:36.394352 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: [pid: 88550|app: 0|req: 478/942] 10.222.0.26 () {54 vars in 927 bytes} [Wed Aug 17 19:15:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 19:15:36.400111 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70851cd0-2b47-454c-a9b0-7956cb43308e None None] REQUEST_METHOD: `POST` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:15:36.400574 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70851cd0-2b47-454c-a9b0-7956cb43308e None None] SCRIPT_NAME: `/identity` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:15:36.400653 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70851cd0-2b47-454c-a9b0-7956cb43308e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:15:36.420269 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.auth.core [None req-70851cd0-2b47-454c-a9b0-7956cb43308e None None] MFA Rules not processed for user `819d41a279e64291acc60de51e1530ae`. Rule list: `[]` (Enabled: `True`). {{(pid=88551) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 19:15:36.421470 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.common.fernet_utils [None req-70851cd0-2b47-454c-a9b0-7956cb43308e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:15:36.429400 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: [pid: 88551|app: 0|req: 465/943] 10.222.0.26 () {58 vars in 1024 bytes} [Wed Aug 17 19:15:36 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 19:15:36.783788 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8563a5ff-5554-461d-bd6a-9f5bf0b8eeea None None] REQUEST_METHOD: `GET` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:15:36.785187 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8563a5ff-5554-461d-bd6a-9f5bf0b8eeea None None] SCRIPT_NAME: `/identity` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:15:36.785537 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8563a5ff-5554-461d-bd6a-9f5bf0b8eeea None None] PATH_INFO: `/` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:15:36.786994 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: [pid: 88550|app: 0|req: 479/944] 10.222.0.26 () {54 vars in 965 bytes} [Wed Aug 17 19:15:36 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 19:15:36.792833 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a6be536-0997-41c3-a9e3-329db20bfab5 None None] REQUEST_METHOD: `POST` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:15:36.793188 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a6be536-0997-41c3-a9e3-329db20bfab5 None None] SCRIPT_NAME: `/identity` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:15:36.793466 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a6be536-0997-41c3-a9e3-329db20bfab5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:15:36.812880 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.auth.core [None req-8a6be536-0997-41c3-a9e3-329db20bfab5 None None] MFA Rules not processed for user `8240f6e0b65545708f07e040c09e1490`. Rule list: `[]` (Enabled: `True`). {{(pid=88551) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 19:15:36.814072 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.common.fernet_utils [None req-8a6be536-0997-41c3-a9e3-329db20bfab5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:15:36.820964 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: [pid: 88551|app: 0|req: 466/945] 10.222.0.26 () {58 vars in 1062 bytes} [Wed Aug 17 19:15:36 2022] POST /identity/v3/auth/tokens => generated 2681 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 19:15:36.829848 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8563a5ff-5554-461d-bd6a-9f5bf0b8eeea None None] Authenticating user token {{(pid=88550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:15:36.841377 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8563a5ff-5554-461d-bd6a-9f5bf0b8eeea None None] Validating token access rules against request {{(pid=88550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:15:36.844957 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b68a321-3b2f-4050-b5e1-76a2173f577f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8240f6e0b65545708f07e040c09e1490', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4bbf6c5abd684d899d09a08b0847d81c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:15:36.845553 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b68a321-3b2f-4050-b5e1-76a2173f577f service neutron] REQUEST_METHOD: `GET` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:15:36.845834 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b68a321-3b2f-4050-b5e1-76a2173f577f service neutron] SCRIPT_NAME: `/identity` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:15:36.846176 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b68a321-3b2f-4050-b5e1-76a2173f577f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:15:36.855366 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b68a321-3b2f-4050-b5e1-76a2173f577f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:15:36.856808 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b68a321-3b2f-4050-b5e1-76a2173f577f service neutron] RBAC: Authorization granted {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:15:36.866913 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: [pid: 88550|app: 0|req: 480/946] 10.222.0.26 () {60 vars in 1365 bytes} [Wed Aug 17 19:15:36 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 19:15:39.296522 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e43fc5e4-e977-4bca-b3be-21f893bb1b49 None None] REQUEST_METHOD: `GET` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:15:39.297054 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e43fc5e4-e977-4bca-b3be-21f893bb1b49 None None] SCRIPT_NAME: `/identity` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:15:39.297142 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e43fc5e4-e977-4bca-b3be-21f893bb1b49 None None] PATH_INFO: `/` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:15:39.298403 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: [pid: 88551|app: 0|req: 467/947] 10.222.0.26 () {54 vars in 927 bytes} [Wed Aug 17 19:15:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 19:15:39.303790 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c0d2bc-7f14-492b-a4ca-a8b7d8375384 None None] REQUEST_METHOD: `POST` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:15:39.304268 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c0d2bc-7f14-492b-a4ca-a8b7d8375384 None None] SCRIPT_NAME: `/identity` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:15:39.304375 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c0d2bc-7f14-492b-a4ca-a8b7d8375384 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:15:39.323659 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.auth.core [None req-83c0d2bc-7f14-492b-a4ca-a8b7d8375384 None None] MFA Rules not processed for user `819d41a279e64291acc60de51e1530ae`. Rule list: `[]` (Enabled: `True`). {{(pid=88550) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 19:15:39.324866 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.common.fernet_utils [None req-83c0d2bc-7f14-492b-a4ca-a8b7d8375384 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:15:39.332582 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: [pid: 88550|app: 0|req: 481/948] 10.222.0.26 () {58 vars in 1024 bytes} [Wed Aug 17 19:15:39 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 19:15:39.672038 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e43fc5e4-e977-4bca-b3be-21f893bb1b49 None None] Authenticating user token {{(pid=88551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:15:39.683101 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e43fc5e4-e977-4bca-b3be-21f893bb1b49 None None] Validating token access rules against request {{(pid=88551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:15:39.686670 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c476672d-2df1-4278-ab1e-eb772071563f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8240f6e0b65545708f07e040c09e1490', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4bbf6c5abd684d899d09a08b0847d81c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:15:39.687510 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c476672d-2df1-4278-ab1e-eb772071563f service neutron] REQUEST_METHOD: `GET` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:15:39.687794 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c476672d-2df1-4278-ab1e-eb772071563f service neutron] SCRIPT_NAME: `/identity` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:15:39.688065 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c476672d-2df1-4278-ab1e-eb772071563f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:15:39.697800 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c476672d-2df1-4278-ab1e-eb772071563f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:15:39.699255 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c476672d-2df1-4278-ab1e-eb772071563f service neutron] RBAC: Authorization granted {{(pid=88551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:15:39.708879 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: [pid: 88551|app: 0|req: 468/949] 10.222.0.26 () {60 vars in 1365 bytes} [Wed Aug 17 19:15:39 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 19:15:41.941827 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87116d32-1465-4bd7-859e-5a0dc63a369b None None] REQUEST_METHOD: `GET` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:15:41.942375 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87116d32-1465-4bd7-859e-5a0dc63a369b None None] SCRIPT_NAME: `/identity` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:15:41.942375 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87116d32-1465-4bd7-859e-5a0dc63a369b None None] PATH_INFO: `/` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:15:41.943773 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: [pid: 88550|app: 0|req: 482/950] 10.222.0.26 () {54 vars in 927 bytes} [Wed Aug 17 19:15:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 19:15:41.949555 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a6fa78c-6071-45ef-9e19-8c3bbe451b7d None None] REQUEST_METHOD: `POST` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:15:41.949998 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a6fa78c-6071-45ef-9e19-8c3bbe451b7d None None] SCRIPT_NAME: `/identity` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:15:41.950096 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a6fa78c-6071-45ef-9e19-8c3bbe451b7d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:15:41.969357 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.auth.core [None req-2a6fa78c-6071-45ef-9e19-8c3bbe451b7d None None] MFA Rules not processed for user `42ca546140f547848db6ed420a5044f3`. Rule list: `[]` (Enabled: `True`). {{(pid=88551) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 19:15:41.970754 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.common.fernet_utils [None req-2a6fa78c-6071-45ef-9e19-8c3bbe451b7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:15:41.979320 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: [pid: 88551|app: 0|req: 469/951] 10.222.0.26 () {58 vars in 1024 bytes} [Wed Aug 17 19:15:41 2022] POST /identity/v3/auth/tokens => generated 2803 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 19:15:42.329814 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87116d32-1465-4bd7-859e-5a0dc63a369b None None] Authenticating user token {{(pid=88550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:15:42.341244 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87116d32-1465-4bd7-859e-5a0dc63a369b None None] Validating token access rules against request {{(pid=88550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:15:42.344741 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23b853b1-02c0-4546-bfd4-b35f135c70b1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8240f6e0b65545708f07e040c09e1490', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4bbf6c5abd684d899d09a08b0847d81c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:15:42.345323 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b853b1-02c0-4546-bfd4-b35f135c70b1 service neutron] REQUEST_METHOD: `GET` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:15:42.345600 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b853b1-02c0-4546-bfd4-b35f135c70b1 service neutron] SCRIPT_NAME: `/identity` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:15:42.345872 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b853b1-02c0-4546-bfd4-b35f135c70b1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:15:42.355477 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23b853b1-02c0-4546-bfd4-b35f135c70b1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:15:42.356894 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23b853b1-02c0-4546-bfd4-b35f135c70b1 service neutron] RBAC: Authorization granted {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:15:42.366433 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: [pid: 88550|app: 0|req: 483/952] 10.222.0.26 () {60 vars in 1365 bytes} [Wed Aug 17 19:15:42 2022] GET /identity/v3/auth/tokens => generated 2803 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 19:15:45.011792 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba80e077-9f06-4b2e-828e-c6de863448a1 None None] REQUEST_METHOD: `GET` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:15:45.012317 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba80e077-9f06-4b2e-828e-c6de863448a1 None None] SCRIPT_NAME: `/identity` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:15:45.012427 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba80e077-9f06-4b2e-828e-c6de863448a1 None None] PATH_INFO: `/` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:15:45.013683 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: [pid: 88551|app: 0|req: 470/953] 10.222.0.26 () {54 vars in 927 bytes} [Wed Aug 17 19:15:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 19:15:45.019004 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7011fa0-7242-4a0e-962f-a7549137a325 None None] REQUEST_METHOD: `POST` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:15:45.019408 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7011fa0-7242-4a0e-962f-a7549137a325 None None] SCRIPT_NAME: `/identity` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:15:45.019559 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7011fa0-7242-4a0e-962f-a7549137a325 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:15:45.038773 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.auth.core [None req-e7011fa0-7242-4a0e-962f-a7549137a325 None None] MFA Rules not processed for user `819d41a279e64291acc60de51e1530ae`. Rule list: `[]` (Enabled: `True`). {{(pid=88550) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 19:15:45.039968 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.common.fernet_utils [None req-e7011fa0-7242-4a0e-962f-a7549137a325 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:15:45.047863 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: [pid: 88550|app: 0|req: 484/954] 10.222.0.26 () {58 vars in 1024 bytes} [Wed Aug 17 19:15:45 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 19:15:45.409054 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba80e077-9f06-4b2e-828e-c6de863448a1 None None] Authenticating user token {{(pid=88551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:15:45.420415 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba80e077-9f06-4b2e-828e-c6de863448a1 None None] Validating token access rules against request {{(pid=88551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:15:45.424061 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68b8253d-be77-4b5b-9bd2-72a6f64b9156 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8240f6e0b65545708f07e040c09e1490', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4bbf6c5abd684d899d09a08b0847d81c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:15:45.424735 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b8253d-be77-4b5b-9bd2-72a6f64b9156 service neutron] REQUEST_METHOD: `GET` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:15:45.425010 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b8253d-be77-4b5b-9bd2-72a6f64b9156 service neutron] SCRIPT_NAME: `/identity` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:15:45.425276 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b8253d-be77-4b5b-9bd2-72a6f64b9156 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:15:45.434262 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68b8253d-be77-4b5b-9bd2-72a6f64b9156 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:15:45.435747 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68b8253d-be77-4b5b-9bd2-72a6f64b9156 service neutron] RBAC: Authorization granted {{(pid=88551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:15:45.445878 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: [pid: 88551|app: 0|req: 471/955] 10.222.0.26 () {60 vars in 1365 bytes} [Wed Aug 17 19:15:45 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 19:15:47.707528 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb5f0635-2148-41dc-982f-720da1480511 None None] REQUEST_METHOD: `GET` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:15:47.708088 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb5f0635-2148-41dc-982f-720da1480511 None None] SCRIPT_NAME: `/identity` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:15:47.708088 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb5f0635-2148-41dc-982f-720da1480511 None None] PATH_INFO: `/` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:15:47.709405 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: [pid: 88550|app: 0|req: 485/956] 10.222.0.26 () {54 vars in 927 bytes} [Wed Aug 17 19:15:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 19:15:47.715001 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f31a3288-2e40-451a-a5af-e6bd33118f49 None None] REQUEST_METHOD: `POST` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:15:47.715418 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f31a3288-2e40-451a-a5af-e6bd33118f49 None None] SCRIPT_NAME: `/identity` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:15:47.715574 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f31a3288-2e40-451a-a5af-e6bd33118f49 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:15:47.722887 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG dbcounter [-] [88551] Writing DB stats keystone:SELECT=100 {{(pid=88551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:15:47.735460 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.auth.core [None req-f31a3288-2e40-451a-a5af-e6bd33118f49 None None] MFA Rules not processed for user `819d41a279e64291acc60de51e1530ae`. Rule list: `[]` (Enabled: `True`). {{(pid=88551) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 19:15:47.736736 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.common.fernet_utils [None req-f31a3288-2e40-451a-a5af-e6bd33118f49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:15:47.745218 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: [pid: 88551|app: 0|req: 472/957] 10.222.0.26 () {58 vars in 1024 bytes} [Wed Aug 17 19:15:47 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 19:15:48.098016 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb5f0635-2148-41dc-982f-720da1480511 None None] Authenticating user token {{(pid=88550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:15:48.109010 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb5f0635-2148-41dc-982f-720da1480511 None None] Validating token access rules against request {{(pid=88550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:15:48.113095 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32defac5-a83f-4477-941b-131f4740ce92 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8240f6e0b65545708f07e040c09e1490', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4bbf6c5abd684d899d09a08b0847d81c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:15:48.113789 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32defac5-a83f-4477-941b-131f4740ce92 service neutron] REQUEST_METHOD: `GET` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:15:48.114139 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32defac5-a83f-4477-941b-131f4740ce92 service neutron] SCRIPT_NAME: `/identity` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:15:48.114479 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32defac5-a83f-4477-941b-131f4740ce92 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:15:48.124535 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32defac5-a83f-4477-941b-131f4740ce92 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:15:48.125961 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32defac5-a83f-4477-941b-131f4740ce92 service neutron] RBAC: Authorization granted {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:15:48.140994 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: [pid: 88550|app: 0|req: 486/958] 10.222.0.26 () {60 vars in 1365 bytes} [Wed Aug 17 19:15:48 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 19:15:51.376024 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fda13d3-a0e2-4263-bef1-0a99af3ab799 None None] REQUEST_METHOD: `GET` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:15:51.376577 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fda13d3-a0e2-4263-bef1-0a99af3ab799 None None] SCRIPT_NAME: `/identity` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:15:51.376577 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fda13d3-a0e2-4263-bef1-0a99af3ab799 None None] PATH_INFO: `/` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:15:51.377923 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: [pid: 88551|app: 0|req: 473/959] 10.222.0.26 () {54 vars in 927 bytes} [Wed Aug 17 19:15:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 19:15:51.383684 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a8058e5-ebe2-460c-aefe-b4891c7fe493 None None] REQUEST_METHOD: `POST` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:15:51.384106 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a8058e5-ebe2-460c-aefe-b4891c7fe493 None None] SCRIPT_NAME: `/identity` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:15:51.384236 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a8058e5-ebe2-460c-aefe-b4891c7fe493 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:15:51.391667 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG dbcounter [-] [88550] Writing DB stats keystone:SELECT=71 {{(pid=88550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:15:51.403748 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.auth.core [None req-3a8058e5-ebe2-460c-aefe-b4891c7fe493 None None] MFA Rules not processed for user `819d41a279e64291acc60de51e1530ae`. Rule list: `[]` (Enabled: `True`). {{(pid=88550) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 19:15:51.404955 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.common.fernet_utils [None req-3a8058e5-ebe2-460c-aefe-b4891c7fe493 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:15:51.413302 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: [pid: 88550|app: 0|req: 487/960] 10.222.0.26 () {58 vars in 1024 bytes} [Wed Aug 17 19:15:51 2022] POST /identity/v3/auth/tokens => generated 2798 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 19:15:51.752991 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fda13d3-a0e2-4263-bef1-0a99af3ab799 None None] Authenticating user token {{(pid=88551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:15:51.764350 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fda13d3-a0e2-4263-bef1-0a99af3ab799 None None] Validating token access rules against request {{(pid=88551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:15:51.767786 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61393768-7c4c-41fd-86ca-84b0fcf63ab0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8240f6e0b65545708f07e040c09e1490', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4bbf6c5abd684d899d09a08b0847d81c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:15:51.768363 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61393768-7c4c-41fd-86ca-84b0fcf63ab0 service neutron] REQUEST_METHOD: `GET` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:15:51.768638 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61393768-7c4c-41fd-86ca-84b0fcf63ab0 service neutron] SCRIPT_NAME: `/identity` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:15:51.768907 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61393768-7c4c-41fd-86ca-84b0fcf63ab0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:15:51.777543 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61393768-7c4c-41fd-86ca-84b0fcf63ab0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:15:51.778994 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61393768-7c4c-41fd-86ca-84b0fcf63ab0 service neutron] RBAC: Authorization granted {{(pid=88551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:15:51.788553 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: [pid: 88551|app: 0|req: 474/961] 10.222.0.26 () {60 vars in 1365 bytes} [Wed Aug 17 19:15:51 2022] GET /identity/v3/auth/tokens => generated 2798 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 19:15:56.351786 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-379ec851-8cb7-46bd-a01e-508460c75c8f None None] REQUEST_METHOD: `GET` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:15:56.352325 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-379ec851-8cb7-46bd-a01e-508460c75c8f None None] SCRIPT_NAME: `/identity` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:15:56.352415 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-379ec851-8cb7-46bd-a01e-508460c75c8f None None] PATH_INFO: `/` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:15:56.353804 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: [pid: 88550|app: 0|req: 488/962] 10.222.0.26 () {54 vars in 927 bytes} [Wed Aug 17 19:15:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 19:15:56.359008 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9935ff2-523a-4a3a-9320-ac22dcbac174 None None] REQUEST_METHOD: `POST` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:15:56.359401 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9935ff2-523a-4a3a-9320-ac22dcbac174 None None] SCRIPT_NAME: `/identity` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:15:56.359569 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9935ff2-523a-4a3a-9320-ac22dcbac174 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:15:56.379589 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.auth.core [None req-c9935ff2-523a-4a3a-9320-ac22dcbac174 None None] MFA Rules not processed for user `819d41a279e64291acc60de51e1530ae`. Rule list: `[]` (Enabled: `True`). {{(pid=88551) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 19:15:56.381389 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.common.fernet_utils [None req-c9935ff2-523a-4a3a-9320-ac22dcbac174 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:15:56.389255 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: [pid: 88551|app: 0|req: 475/963] 10.222.0.26 () {58 vars in 1024 bytes} [Wed Aug 17 19:15:56 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 19:15:56.733320 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-379ec851-8cb7-46bd-a01e-508460c75c8f None None] Authenticating user token {{(pid=88550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:15:56.744658 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-379ec851-8cb7-46bd-a01e-508460c75c8f None None] Validating token access rules against request {{(pid=88550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:15:56.748345 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abc5df83-3b72-4c5c-b97e-512ad6f38fd1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8240f6e0b65545708f07e040c09e1490', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4bbf6c5abd684d899d09a08b0847d81c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:15:56.748901 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc5df83-3b72-4c5c-b97e-512ad6f38fd1 service neutron] REQUEST_METHOD: `GET` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:15:56.749172 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc5df83-3b72-4c5c-b97e-512ad6f38fd1 service neutron] SCRIPT_NAME: `/identity` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:15:56.749448 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc5df83-3b72-4c5c-b97e-512ad6f38fd1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:15:56.758359 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abc5df83-3b72-4c5c-b97e-512ad6f38fd1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:15:56.759809 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abc5df83-3b72-4c5c-b97e-512ad6f38fd1 service neutron] RBAC: Authorization granted {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:15:56.769497 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: [pid: 88550|app: 0|req: 489/964] 10.222.0.26 () {60 vars in 1365 bytes} [Wed Aug 17 19:15:56 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 19:16:00.142898 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-234fd907-0476-4f76-9018-7c44e9f1338b None None] REQUEST_METHOD: `GET` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:16:00.143419 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-234fd907-0476-4f76-9018-7c44e9f1338b None None] SCRIPT_NAME: `/identity` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:16:00.143509 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-234fd907-0476-4f76-9018-7c44e9f1338b None None] PATH_INFO: `/` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:16:00.144807 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: [pid: 88551|app: 0|req: 476/965] 10.222.0.26 () {54 vars in 927 bytes} [Wed Aug 17 19:16:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 19:16:00.150493 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-780f93f1-aa52-4e9e-b152-38e1aad1269f None None] REQUEST_METHOD: `POST` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:16:00.150927 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-780f93f1-aa52-4e9e-b152-38e1aad1269f None None] SCRIPT_NAME: `/identity` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:16:00.151079 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-780f93f1-aa52-4e9e-b152-38e1aad1269f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:16:00.170938 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.auth.core [None req-780f93f1-aa52-4e9e-b152-38e1aad1269f None None] MFA Rules not processed for user `819d41a279e64291acc60de51e1530ae`. Rule list: `[]` (Enabled: `True`). {{(pid=88550) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 19:16:00.172143 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.common.fernet_utils [None req-780f93f1-aa52-4e9e-b152-38e1aad1269f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:16:00.180158 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: [pid: 88550|app: 0|req: 490/966] 10.222.0.26 () {58 vars in 1024 bytes} [Wed Aug 17 19:16:00 2022] POST /identity/v3/auth/tokens => generated 2798 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 19:16:00.523005 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-234fd907-0476-4f76-9018-7c44e9f1338b None None] Authenticating user token {{(pid=88551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:16:00.534211 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-234fd907-0476-4f76-9018-7c44e9f1338b None None] Validating token access rules against request {{(pid=88551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:16:00.537774 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb27c526-28a4-4c4a-a16b-24156081b898 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8240f6e0b65545708f07e040c09e1490', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4bbf6c5abd684d899d09a08b0847d81c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:16:00.538453 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb27c526-28a4-4c4a-a16b-24156081b898 service neutron] REQUEST_METHOD: `GET` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:16:00.538666 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb27c526-28a4-4c4a-a16b-24156081b898 service neutron] SCRIPT_NAME: `/identity` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:16:00.538935 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb27c526-28a4-4c4a-a16b-24156081b898 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:16:00.548148 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb27c526-28a4-4c4a-a16b-24156081b898 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:16:00.549554 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb27c526-28a4-4c4a-a16b-24156081b898 service neutron] RBAC: Authorization granted {{(pid=88551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:16:00.558948 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: [pid: 88551|app: 0|req: 477/967] 10.222.0.26 () {60 vars in 1365 bytes} [Wed Aug 17 19:16:00 2022] GET /identity/v3/auth/tokens => generated 2798 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 19:16:05.007176 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2213840-8afa-401b-8318-3fdbc473a9fc None None] REQUEST_METHOD: `GET` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:16:05.007699 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2213840-8afa-401b-8318-3fdbc473a9fc None None] SCRIPT_NAME: `/identity` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:16:05.007699 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2213840-8afa-401b-8318-3fdbc473a9fc None None] PATH_INFO: `/` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:16:05.009066 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: [pid: 88550|app: 0|req: 491/968] 10.222.0.26 () {54 vars in 927 bytes} [Wed Aug 17 19:16:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 19:16:05.015345 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f9be66-d897-4267-895c-c3e864f6703d None None] REQUEST_METHOD: `POST` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:16:05.015776 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f9be66-d897-4267-895c-c3e864f6703d None None] SCRIPT_NAME: `/identity` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:16:05.016166 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f9be66-d897-4267-895c-c3e864f6703d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:16:05.040629 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.auth.core [None req-66f9be66-d897-4267-895c-c3e864f6703d None None] MFA Rules not processed for user `819d41a279e64291acc60de51e1530ae`. Rule list: `[]` (Enabled: `True`). {{(pid=88551) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 19:16:05.042028 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.common.fernet_utils [None req-66f9be66-d897-4267-895c-c3e864f6703d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:16:05.054614 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: [pid: 88551|app: 0|req: 478/969] 10.222.0.26 () {58 vars in 1024 bytes} [Wed Aug 17 19:16:05 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 19:16:05.396513 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2213840-8afa-401b-8318-3fdbc473a9fc None None] Authenticating user token {{(pid=88550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:16:05.410048 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2213840-8afa-401b-8318-3fdbc473a9fc None None] Validating token access rules against request {{(pid=88550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:16:05.414636 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cf22efa-7893-4ba6-af53-40caaefbc533 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8240f6e0b65545708f07e040c09e1490', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4bbf6c5abd684d899d09a08b0847d81c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:16:05.415232 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf22efa-7893-4ba6-af53-40caaefbc533 service neutron] REQUEST_METHOD: `GET` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:16:05.415503 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf22efa-7893-4ba6-af53-40caaefbc533 service neutron] SCRIPT_NAME: `/identity` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:16:05.415769 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf22efa-7893-4ba6-af53-40caaefbc533 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:16:05.425756 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cf22efa-7893-4ba6-af53-40caaefbc533 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:16:05.427701 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cf22efa-7893-4ba6-af53-40caaefbc533 service neutron] RBAC: Authorization granted {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:16:05.437659 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: [pid: 88550|app: 0|req: 492/970] 10.222.0.26 () {60 vars in 1365 bytes} [Wed Aug 17 19:16:05 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 19:16:10.886644 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d00ccd8-c68d-4787-b073-4efd8692c1c5 None None] REQUEST_METHOD: `GET` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:16:10.887087 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d00ccd8-c68d-4787-b073-4efd8692c1c5 None None] SCRIPT_NAME: `/identity` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:16:10.887190 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d00ccd8-c68d-4787-b073-4efd8692c1c5 None None] PATH_INFO: `/` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:16:10.888497 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: [pid: 88551|app: 0|req: 479/971] 10.222.0.26 () {54 vars in 921 bytes} [Wed Aug 17 19:16:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 19:16:10.893603 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc3e4f2f-039b-405e-8e81-345899aa1e56 None None] REQUEST_METHOD: `POST` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:16:10.894008 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc3e4f2f-039b-405e-8e81-345899aa1e56 None None] SCRIPT_NAME: `/identity` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:16:10.894152 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc3e4f2f-039b-405e-8e81-345899aa1e56 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:16:10.939077 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.auth.core [None req-fc3e4f2f-039b-405e-8e81-345899aa1e56 None None] MFA Rules not processed for user `6478a47e33024d1abc99f078dbc30787`. Rule list: `[]` (Enabled: `True`). {{(pid=88550) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 19:16:10.940573 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.common.fernet_utils [None req-fc3e4f2f-039b-405e-8e81-345899aa1e56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:16:11.040234 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: [pid: 88550|app: 0|req: 493/972] 10.222.0.26 () {58 vars in 1018 bytes} [Wed Aug 17 19:16:10 2022] POST /identity/v3/auth/tokens => generated 2868 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 19:16:15.034380 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG dbcounter [-] [88551] Writing DB stats keystone:SELECT=20 {{(pid=88551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:16:15.574340 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26704683-bf96-4cd9-be09-bfd76639a9ba None None] REQUEST_METHOD: `GET` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:16:15.574789 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26704683-bf96-4cd9-be09-bfd76639a9ba None None] SCRIPT_NAME: `/identity` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:16:15.574975 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26704683-bf96-4cd9-be09-bfd76639a9ba None None] PATH_INFO: `/` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:16:15.576463 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: [pid: 88551|app: 0|req: 480/973] 10.222.0.26 () {54 vars in 921 bytes} [Wed Aug 17 19:16:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 19:16:15.582079 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beffc845-2aff-469d-9c28-2f87f9b2f2ac None None] REQUEST_METHOD: `POST` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:16:15.582694 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beffc845-2aff-469d-9c28-2f87f9b2f2ac None None] SCRIPT_NAME: `/identity` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:16:15.582785 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beffc845-2aff-469d-9c28-2f87f9b2f2ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:16:15.603078 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.auth.core [None req-beffc845-2aff-469d-9c28-2f87f9b2f2ac None None] MFA Rules not processed for user `6478a47e33024d1abc99f078dbc30787`. Rule list: `[]` (Enabled: `True`). {{(pid=88550) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 19:16:15.604277 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.common.fernet_utils [None req-beffc845-2aff-469d-9c28-2f87f9b2f2ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:16:15.612972 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: [pid: 88550|app: 0|req: 494/974] 10.222.0.26 () {58 vars in 1018 bytes} [Wed Aug 17 19:16:15 2022] POST /identity/v3/auth/tokens => generated 2868 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 19:16:17.516393 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dbf0fd8-2981-4fe5-95bd-ace5317b9ccd None None] REQUEST_METHOD: `GET` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:16:17.516989 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dbf0fd8-2981-4fe5-95bd-ace5317b9ccd None None] SCRIPT_NAME: `/identity` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:16:17.516989 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dbf0fd8-2981-4fe5-95bd-ace5317b9ccd None None] PATH_INFO: `/` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:16:17.518277 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: [pid: 88551|app: 0|req: 481/975] 10.222.0.26 () {54 vars in 921 bytes} [Wed Aug 17 19:16:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 19:16:17.524355 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-261e1a81-49ed-432c-8813-93f0e3ff3a40 None None] REQUEST_METHOD: `POST` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:16:17.524899 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-261e1a81-49ed-432c-8813-93f0e3ff3a40 None None] SCRIPT_NAME: `/identity` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:16:17.524899 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-261e1a81-49ed-432c-8813-93f0e3ff3a40 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:16:17.546349 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.auth.core [None req-261e1a81-49ed-432c-8813-93f0e3ff3a40 None None] MFA Rules not processed for user `6478a47e33024d1abc99f078dbc30787`. Rule list: `[]` (Enabled: `True`). {{(pid=88550) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 19:16:17.547639 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.common.fernet_utils [None req-261e1a81-49ed-432c-8813-93f0e3ff3a40 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:16:17.557227 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: [pid: 88550|app: 0|req: 495/976] 10.222.0.26 () {58 vars in 1018 bytes} [Wed Aug 17 19:16:17 2022] POST /identity/v3/auth/tokens => generated 2868 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 19:16:21.396749 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef9f070b-4111-4dc6-ba6f-b36f92fad807 None None] REQUEST_METHOD: `GET` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:16:21.397458 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef9f070b-4111-4dc6-ba6f-b36f92fad807 None None] SCRIPT_NAME: `/identity` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:16:21.397458 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef9f070b-4111-4dc6-ba6f-b36f92fad807 None None] PATH_INFO: `/` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:16:21.399263 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: [pid: 88551|app: 0|req: 482/977] 10.222.0.26 () {54 vars in 927 bytes} [Wed Aug 17 19:16:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 17 19:16:21.405848 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3287677f-8422-40b8-9907-0774602fd28d None None] REQUEST_METHOD: `POST` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:16:21.406771 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3287677f-8422-40b8-9907-0774602fd28d None None] SCRIPT_NAME: `/identity` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:16:21.406771 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3287677f-8422-40b8-9907-0774602fd28d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:16:21.427615 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.auth.core [None req-3287677f-8422-40b8-9907-0774602fd28d None None] MFA Rules not processed for user `819d41a279e64291acc60de51e1530ae`. Rule list: `[]` (Enabled: `True`). {{(pid=88550) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 19:16:21.429076 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.common.fernet_utils [None req-3287677f-8422-40b8-9907-0774602fd28d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:16:21.442593 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: [pid: 88550|app: 0|req: 496/978] 10.222.0.26 () {58 vars in 1024 bytes} [Wed Aug 17 19:16:21 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 19:16:21.807826 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48253c5b-5c2f-42c8-afc3-6a20c2555675 None None] REQUEST_METHOD: `GET` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:16:21.808392 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48253c5b-5c2f-42c8-afc3-6a20c2555675 None None] SCRIPT_NAME: `/identity` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:16:21.808894 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48253c5b-5c2f-42c8-afc3-6a20c2555675 None None] PATH_INFO: `/` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:16:21.810959 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: [pid: 88551|app: 0|req: 483/979] 10.222.0.26 () {54 vars in 962 bytes} [Wed Aug 17 19:16:21 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 19:16:21.818476 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-febda588-8ab5-4941-a9da-1a1a4f441eed None None] REQUEST_METHOD: `POST` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:16:21.819197 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-febda588-8ab5-4941-a9da-1a1a4f441eed None None] SCRIPT_NAME: `/identity` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:16:21.819684 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-febda588-8ab5-4941-a9da-1a1a4f441eed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:16:21.829372 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG dbcounter [-] [88550] Writing DB stats keystone:SELECT=66 {{(pid=88550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:16:21.864439 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.auth.core [None req-febda588-8ab5-4941-a9da-1a1a4f441eed None None] MFA Rules not processed for user `9ae23e7a10d54989a25c9f3019184d01`. Rule list: `[]` (Enabled: `True`). {{(pid=88550) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 19:16:21.870252 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.common.fernet_utils [None req-febda588-8ab5-4941-a9da-1a1a4f441eed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:16:21.955081 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: [pid: 88550|app: 0|req: 497/980] 10.222.0.26 () {58 vars in 1059 bytes} [Wed Aug 17 19:16:21 2022] POST /identity/v3/auth/tokens => generated 2863 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 17 19:16:21.963463 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48253c5b-5c2f-42c8-afc3-6a20c2555675 None None] Authenticating user token {{(pid=88551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:16:21.978675 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48253c5b-5c2f-42c8-afc3-6a20c2555675 None None] Validating token access rules against request {{(pid=88551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:16:21.983780 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a00a097-0f29-4e76-8877-74f0b6ad004e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ae23e7a10d54989a25c9f3019184d01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4bbf6c5abd684d899d09a08b0847d81c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:16:21.984329 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a00a097-0f29-4e76-8877-74f0b6ad004e service nova] REQUEST_METHOD: `GET` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:16:21.984608 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a00a097-0f29-4e76-8877-74f0b6ad004e service nova] SCRIPT_NAME: `/identity` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:16:21.984877 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a00a097-0f29-4e76-8877-74f0b6ad004e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:16:21.994465 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a00a097-0f29-4e76-8877-74f0b6ad004e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:16:21.996104 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a00a097-0f29-4e76-8877-74f0b6ad004e service nova] RBAC: Authorization granted {{(pid=88551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:16:22.008931 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: [pid: 88551|app: 0|req: 484/981] 10.222.0.26 () {60 vars in 1365 bytes} [Wed Aug 17 19:16:21 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 19:16:24.466531 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a642fd22-1a20-479c-a5e3-0d543f3abf4f None None] REQUEST_METHOD: `GET` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:16:24.467124 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a642fd22-1a20-479c-a5e3-0d543f3abf4f None None] SCRIPT_NAME: `/identity` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:16:24.467124 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a642fd22-1a20-479c-a5e3-0d543f3abf4f None None] PATH_INFO: `/` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:16:24.468524 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: [pid: 88550|app: 0|req: 498/982] 10.222.0.26 () {54 vars in 927 bytes} [Wed Aug 17 19:16:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 19:16:24.473616 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39057da9-53e4-40b9-82af-cccbd30b8998 None None] REQUEST_METHOD: `POST` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:16:24.474025 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39057da9-53e4-40b9-82af-cccbd30b8998 None None] SCRIPT_NAME: `/identity` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:16:24.474159 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39057da9-53e4-40b9-82af-cccbd30b8998 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:16:24.498999 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.auth.core [None req-39057da9-53e4-40b9-82af-cccbd30b8998 None None] MFA Rules not processed for user `819d41a279e64291acc60de51e1530ae`. Rule list: `[]` (Enabled: `True`). {{(pid=88551) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 19:16:24.500152 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.common.fernet_utils [None req-39057da9-53e4-40b9-82af-cccbd30b8998 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:16:24.508551 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: [pid: 88551|app: 0|req: 485/983] 10.222.0.26 () {58 vars in 1024 bytes} [Wed Aug 17 19:16:24 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 19:16:24.861559 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a642fd22-1a20-479c-a5e3-0d543f3abf4f None None] Authenticating user token {{(pid=88550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:16:24.878011 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a642fd22-1a20-479c-a5e3-0d543f3abf4f None None] Validating token access rules against request {{(pid=88550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:16:24.885236 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3da9237b-10d7-465a-8704-c0e8d3b3b5a7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ae23e7a10d54989a25c9f3019184d01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4bbf6c5abd684d899d09a08b0847d81c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:16:24.885925 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da9237b-10d7-465a-8704-c0e8d3b3b5a7 service nova] REQUEST_METHOD: `GET` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:16:24.886269 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da9237b-10d7-465a-8704-c0e8d3b3b5a7 service nova] SCRIPT_NAME: `/identity` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:16:24.886627 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da9237b-10d7-465a-8704-c0e8d3b3b5a7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:16:24.897072 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3da9237b-10d7-465a-8704-c0e8d3b3b5a7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:16:24.898794 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3da9237b-10d7-465a-8704-c0e8d3b3b5a7 service nova] RBAC: Authorization granted {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:16:24.910930 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: [pid: 88550|app: 0|req: 499/984] 10.222.0.26 () {60 vars in 1365 bytes} [Wed Aug 17 19:16:24 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 19:16:27.652427 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df776bed-7dd9-41d0-9b69-8423bcc450eb None None] REQUEST_METHOD: `GET` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:16:27.652959 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df776bed-7dd9-41d0-9b69-8423bcc450eb None None] SCRIPT_NAME: `/identity` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:16:27.652959 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df776bed-7dd9-41d0-9b69-8423bcc450eb None None] PATH_INFO: `/` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:16:27.654271 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: [pid: 88551|app: 0|req: 486/985] 10.222.0.26 () {54 vars in 927 bytes} [Wed Aug 17 19:16:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 19:16:27.659388 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ae6471-0bb1-4e7b-bd84-40df6865d7fe None None] REQUEST_METHOD: `POST` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:16:27.659823 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ae6471-0bb1-4e7b-bd84-40df6865d7fe None None] SCRIPT_NAME: `/identity` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:16:27.660527 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ae6471-0bb1-4e7b-bd84-40df6865d7fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:16:27.682573 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.auth.core [None req-65ae6471-0bb1-4e7b-bd84-40df6865d7fe None None] MFA Rules not processed for user `819d41a279e64291acc60de51e1530ae`. Rule list: `[]` (Enabled: `True`). {{(pid=88550) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 19:16:27.682573 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.common.fernet_utils [None req-65ae6471-0bb1-4e7b-bd84-40df6865d7fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:16:27.693956 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: [pid: 88550|app: 0|req: 500/986] 10.222.0.26 () {58 vars in 1024 bytes} [Wed Aug 17 19:16:27 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 19:16:28.092525 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b8e3a1-b6d6-4216-bede-90ab0574a116 None None] REQUEST_METHOD: `GET` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:16:28.092952 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b8e3a1-b6d6-4216-bede-90ab0574a116 None None] SCRIPT_NAME: `/identity` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:16:28.093301 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b8e3a1-b6d6-4216-bede-90ab0574a116 None None] PATH_INFO: `/` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:16:28.094743 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: [pid: 88551|app: 0|req: 487/987] 10.222.0.26 () {54 vars in 962 bytes} [Wed Aug 17 19:16:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 19:16:28.101245 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb7e3011-510b-4514-be58-668e53171c19 None None] REQUEST_METHOD: `POST` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:16:28.107056 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb7e3011-510b-4514-be58-668e53171c19 None None] SCRIPT_NAME: `/identity` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:16:28.107056 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb7e3011-510b-4514-be58-668e53171c19 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:16:28.125593 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.auth.core [None req-bb7e3011-510b-4514-be58-668e53171c19 None None] MFA Rules not processed for user `9ae23e7a10d54989a25c9f3019184d01`. Rule list: `[]` (Enabled: `True`). {{(pid=88550) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 19:16:28.127923 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.common.fernet_utils [None req-bb7e3011-510b-4514-be58-668e53171c19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:16:28.146699 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: [pid: 88550|app: 0|req: 501/988] 10.222.0.26 () {58 vars in 1059 bytes} [Wed Aug 17 19:16:28 2022] POST /identity/v3/auth/tokens => generated 2863 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 19:16:28.149615 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38b8e3a1-b6d6-4216-bede-90ab0574a116 None None] Authenticating user token {{(pid=88551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:16:28.165350 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38b8e3a1-b6d6-4216-bede-90ab0574a116 None None] Validating token access rules against request {{(pid=88551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:16:28.173426 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-565a1d4c-e3d8-4f98-9a9a-3c5ba4e7cab7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ae23e7a10d54989a25c9f3019184d01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4bbf6c5abd684d899d09a08b0847d81c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:16:28.179989 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-565a1d4c-e3d8-4f98-9a9a-3c5ba4e7cab7 service nova] REQUEST_METHOD: `GET` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:16:28.179989 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-565a1d4c-e3d8-4f98-9a9a-3c5ba4e7cab7 service nova] SCRIPT_NAME: `/identity` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:16:28.179989 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-565a1d4c-e3d8-4f98-9a9a-3c5ba4e7cab7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:16:28.185579 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-565a1d4c-e3d8-4f98-9a9a-3c5ba4e7cab7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:16:28.186412 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-565a1d4c-e3d8-4f98-9a9a-3c5ba4e7cab7 service nova] RBAC: Authorization granted {{(pid=88551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:16:28.200903 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: [pid: 88551|app: 0|req: 488/989] 10.222.0.26 () {60 vars in 1365 bytes} [Wed Aug 17 19:16:28 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 19:16:30.736895 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01253f04-3819-4575-bcc8-16d92d24f8d6 None None] REQUEST_METHOD: `GET` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:16:30.738190 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01253f04-3819-4575-bcc8-16d92d24f8d6 None None] SCRIPT_NAME: `/identity` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:16:30.738727 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01253f04-3819-4575-bcc8-16d92d24f8d6 None None] PATH_INFO: `/` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:16:30.740637 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: [pid: 88550|app: 0|req: 502/990] 10.222.0.26 () {54 vars in 927 bytes} [Wed Aug 17 19:16:30 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 19:16:30.746198 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b5bcf7-9bde-4094-bf1e-cdaa73b6ae92 None None] REQUEST_METHOD: `POST` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:16:30.747186 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b5bcf7-9bde-4094-bf1e-cdaa73b6ae92 None None] SCRIPT_NAME: `/identity` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:16:30.747634 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b5bcf7-9bde-4094-bf1e-cdaa73b6ae92 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:16:30.769264 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.auth.core [None req-92b5bcf7-9bde-4094-bf1e-cdaa73b6ae92 None None] MFA Rules not processed for user `819d41a279e64291acc60de51e1530ae`. Rule list: `[]` (Enabled: `True`). {{(pid=88551) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 19:16:30.770774 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.common.fernet_utils [None req-92b5bcf7-9bde-4094-bf1e-cdaa73b6ae92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:16:30.789401 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: [pid: 88551|app: 0|req: 489/991] 10.222.0.26 () {58 vars in 1024 bytes} [Wed Aug 17 19:16:30 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 19:16:31.144861 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01253f04-3819-4575-bcc8-16d92d24f8d6 None None] Authenticating user token {{(pid=88550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:16:31.160201 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01253f04-3819-4575-bcc8-16d92d24f8d6 None None] Validating token access rules against request {{(pid=88550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:16:31.165565 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15a47232-1934-402b-9854-ba8a1776f08f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ae23e7a10d54989a25c9f3019184d01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4bbf6c5abd684d899d09a08b0847d81c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:16:31.166436 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a47232-1934-402b-9854-ba8a1776f08f service nova] REQUEST_METHOD: `GET` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:16:31.166898 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a47232-1934-402b-9854-ba8a1776f08f service nova] SCRIPT_NAME: `/identity` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:16:31.167451 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a47232-1934-402b-9854-ba8a1776f08f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:16:31.178977 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15a47232-1934-402b-9854-ba8a1776f08f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:16:31.180920 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15a47232-1934-402b-9854-ba8a1776f08f service nova] RBAC: Authorization granted {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:16:31.206577 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: [pid: 88550|app: 0|req: 503/992] 10.222.0.26 () {60 vars in 1365 bytes} [Wed Aug 17 19:16:31 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 62 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 19:16:31.963132 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d0b997-b0ff-472a-8129-ef284a331325 None None] REQUEST_METHOD: `GET` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:16:31.964407 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d0b997-b0ff-472a-8129-ef284a331325 None None] SCRIPT_NAME: `/identity` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:16:31.965208 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d0b997-b0ff-472a-8129-ef284a331325 None None] PATH_INFO: `/` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:16:31.968863 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: [pid: 88551|app: 0|req: 490/993] 10.222.0.26 () {54 vars in 927 bytes} [Wed Aug 17 19:16:31 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 19:16:31.978842 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd44383-0dfe-4568-9958-8bdd179feadd None None] REQUEST_METHOD: `POST` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:16:31.978842 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd44383-0dfe-4568-9958-8bdd179feadd None None] SCRIPT_NAME: `/identity` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:16:31.978842 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd44383-0dfe-4568-9958-8bdd179feadd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:16:32.015488 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.auth.core [None req-3bd44383-0dfe-4568-9958-8bdd179feadd None None] MFA Rules not processed for user `819d41a279e64291acc60de51e1530ae`. Rule list: `[]` (Enabled: `True`). {{(pid=88550) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 19:16:32.018077 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.common.fernet_utils [None req-3bd44383-0dfe-4568-9958-8bdd179feadd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:16:32.056150 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: [pid: 88550|app: 0|req: 504/994] 10.222.0.26 () {58 vars in 1024 bytes} [Wed Aug 17 19:16:31 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 19:16:32.640006 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a790a46-5ae4-4028-98d6-0956a03e56e2 None None] REQUEST_METHOD: `GET` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:16:32.640290 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a790a46-5ae4-4028-98d6-0956a03e56e2 None None] SCRIPT_NAME: `/identity` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:16:32.640565 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a790a46-5ae4-4028-98d6-0956a03e56e2 None None] PATH_INFO: `/` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:16:32.641883 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: [pid: 88551|app: 0|req: 491/995] 10.222.0.26 () {54 vars in 964 bytes} [Wed Aug 17 19:16:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 19:16:32.647870 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e9e7733-0b2e-45e4-b457-dbc60fb4e0b1 None None] REQUEST_METHOD: `POST` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:16:32.648161 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e9e7733-0b2e-45e4-b457-dbc60fb4e0b1 None None] SCRIPT_NAME: `/identity` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:16:32.648467 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e9e7733-0b2e-45e4-b457-dbc60fb4e0b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:16:32.691354 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.auth.core [None req-9e9e7733-0b2e-45e4-b457-dbc60fb4e0b1 None None] MFA Rules not processed for user `0a7ec0aa480147f897f8a76b5b29f3c4`. Rule list: `[]` (Enabled: `True`). {{(pid=88550) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 19:16:32.692640 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.common.fernet_utils [None req-9e9e7733-0b2e-45e4-b457-dbc60fb4e0b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:16:32.765477 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: [pid: 88550|app: 0|req: 505/996] 10.222.0.26 () {58 vars in 1061 bytes} [Wed Aug 17 19:16:32 2022] POST /identity/v3/auth/tokens => generated 2680 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 19:16:32.774797 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a790a46-5ae4-4028-98d6-0956a03e56e2 None None] Authenticating user token {{(pid=88551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:16:32.786865 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a790a46-5ae4-4028-98d6-0956a03e56e2 None None] Validating token access rules against request {{(pid=88551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:16:32.790997 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07ac49e3-4ca4-49b4-8f93-f510d21ed17c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a7ec0aa480147f897f8a76b5b29f3c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4bbf6c5abd684d899d09a08b0847d81c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:16:32.791619 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ac49e3-4ca4-49b4-8f93-f510d21ed17c service cinder] REQUEST_METHOD: `GET` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:16:32.791893 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ac49e3-4ca4-49b4-8f93-f510d21ed17c service cinder] SCRIPT_NAME: `/identity` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:16:32.792157 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ac49e3-4ca4-49b4-8f93-f510d21ed17c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:16:32.802762 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07ac49e3-4ca4-49b4-8f93-f510d21ed17c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:16:32.804417 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07ac49e3-4ca4-49b4-8f93-f510d21ed17c service cinder] RBAC: Authorization granted {{(pid=88551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:16:32.815472 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: [pid: 88551|app: 0|req: 492/997] 10.222.0.26 () {60 vars in 1365 bytes} [Wed Aug 17 19:16:32 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 19:16:33.715457 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c0df27-2e7c-418b-9f16-e81839e2da8d None None] REQUEST_METHOD: `GET` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:16:33.715457 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c0df27-2e7c-418b-9f16-e81839e2da8d None None] SCRIPT_NAME: `/identity` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:16:33.715457 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c0df27-2e7c-418b-9f16-e81839e2da8d None None] PATH_INFO: `/` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:16:33.716430 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: [pid: 88550|app: 0|req: 506/998] 10.222.0.26 () {54 vars in 927 bytes} [Wed Aug 17 19:16:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 19:16:33.721793 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c6873d-de0c-405a-92db-3724caa48afe None None] REQUEST_METHOD: `POST` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:16:33.722259 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c6873d-de0c-405a-92db-3724caa48afe None None] SCRIPT_NAME: `/identity` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:16:33.722489 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c6873d-de0c-405a-92db-3724caa48afe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:16:33.758897 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.auth.core [None req-51c6873d-de0c-405a-92db-3724caa48afe None None] MFA Rules not processed for user `819d41a279e64291acc60de51e1530ae`. Rule list: `[]` (Enabled: `True`). {{(pid=88551) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 19:16:33.760577 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.common.fernet_utils [None req-51c6873d-de0c-405a-92db-3724caa48afe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:16:33.767994 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: [pid: 88551|app: 0|req: 493/999] 10.222.0.26 () {58 vars in 1024 bytes} [Wed Aug 17 19:16:33 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 19:16:34.128641 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97c0df27-2e7c-418b-9f16-e81839e2da8d None None] Authenticating user token {{(pid=88550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:16:34.144922 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97c0df27-2e7c-418b-9f16-e81839e2da8d None None] Validating token access rules against request {{(pid=88550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:16:34.150346 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ef60ad8-0b77-41c0-bfb9-b8c9598ed4c2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ae23e7a10d54989a25c9f3019184d01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4bbf6c5abd684d899d09a08b0847d81c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:16:34.151151 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef60ad8-0b77-41c0-bfb9-b8c9598ed4c2 service nova] REQUEST_METHOD: `GET` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:16:34.151437 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef60ad8-0b77-41c0-bfb9-b8c9598ed4c2 service nova] SCRIPT_NAME: `/identity` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:16:34.151828 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef60ad8-0b77-41c0-bfb9-b8c9598ed4c2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:16:34.162365 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ef60ad8-0b77-41c0-bfb9-b8c9598ed4c2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:16:34.164384 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ef60ad8-0b77-41c0-bfb9-b8c9598ed4c2 service nova] RBAC: Authorization granted {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:16:34.175718 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: [pid: 88550|app: 0|req: 507/1000] 10.222.0.26 () {60 vars in 1365 bytes} [Wed Aug 17 19:16:34 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 19:16:36.633317 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67dce7d2-2da2-4c62-b2e1-37430967fdd8 None None] REQUEST_METHOD: `GET` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:16:36.633847 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67dce7d2-2da2-4c62-b2e1-37430967fdd8 None None] SCRIPT_NAME: `/identity` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:16:36.633847 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67dce7d2-2da2-4c62-b2e1-37430967fdd8 None None] PATH_INFO: `/` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:16:36.635231 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: [pid: 88551|app: 0|req: 494/1001] 10.222.0.26 () {54 vars in 927 bytes} [Wed Aug 17 19:16:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 19:16:36.640455 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c2c3a9-2c09-4664-9add-48f71d65b06c None None] REQUEST_METHOD: `POST` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:16:36.640907 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c2c3a9-2c09-4664-9add-48f71d65b06c None None] SCRIPT_NAME: `/identity` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:16:36.641009 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c2c3a9-2c09-4664-9add-48f71d65b06c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:16:36.650194 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG dbcounter [-] [88550] Writing DB stats keystone:SELECT=100 {{(pid=88550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:16:36.661468 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.auth.core [None req-68c2c3a9-2c09-4664-9add-48f71d65b06c None None] MFA Rules not processed for user `819d41a279e64291acc60de51e1530ae`. Rule list: `[]` (Enabled: `True`). {{(pid=88550) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 19:16:36.662685 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.common.fernet_utils [None req-68c2c3a9-2c09-4664-9add-48f71d65b06c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:16:36.673642 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: [pid: 88550|app: 0|req: 508/1002] 10.222.0.26 () {58 vars in 1024 bytes} [Wed Aug 17 19:16:36 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 19:16:37.018821 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67dce7d2-2da2-4c62-b2e1-37430967fdd8 None None] Authenticating user token {{(pid=88551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:16:37.032182 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67dce7d2-2da2-4c62-b2e1-37430967fdd8 None None] Validating token access rules against request {{(pid=88551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:16:37.037189 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c468b44-ae1b-4642-91c7-a5342c2104be service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ae23e7a10d54989a25c9f3019184d01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4bbf6c5abd684d899d09a08b0847d81c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:16:37.037843 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c468b44-ae1b-4642-91c7-a5342c2104be service nova] REQUEST_METHOD: `GET` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:16:37.038189 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c468b44-ae1b-4642-91c7-a5342c2104be service nova] SCRIPT_NAME: `/identity` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:16:37.038529 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c468b44-ae1b-4642-91c7-a5342c2104be service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:16:37.046819 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c468b44-ae1b-4642-91c7-a5342c2104be service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:16:37.048379 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c468b44-ae1b-4642-91c7-a5342c2104be service nova] RBAC: Authorization granted {{(pid=88551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:16:37.058596 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: [pid: 88551|app: 0|req: 495/1003] 10.222.0.26 () {60 vars in 1365 bytes} [Wed Aug 17 19:16:37 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 19:16:39.437559 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d7c687-0ac2-49bc-90b0-30ec49933377 None None] REQUEST_METHOD: `GET` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:16:39.438156 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d7c687-0ac2-49bc-90b0-30ec49933377 None None] SCRIPT_NAME: `/identity` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:16:39.438387 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d7c687-0ac2-49bc-90b0-30ec49933377 None None] PATH_INFO: `/` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:16:39.439995 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: [pid: 88550|app: 0|req: 509/1004] 10.222.0.26 () {54 vars in 927 bytes} [Wed Aug 17 19:16:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 19:16:39.445478 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0caba6f3-97ba-4e56-a163-a94064ad64f4 None None] REQUEST_METHOD: `POST` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:16:39.445903 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0caba6f3-97ba-4e56-a163-a94064ad64f4 None None] SCRIPT_NAME: `/identity` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:16:39.446016 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0caba6f3-97ba-4e56-a163-a94064ad64f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:16:39.465034 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.auth.core [None req-0caba6f3-97ba-4e56-a163-a94064ad64f4 None None] MFA Rules not processed for user `819d41a279e64291acc60de51e1530ae`. Rule list: `[]` (Enabled: `True`). {{(pid=88551) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 19:16:39.466281 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.common.fernet_utils [None req-0caba6f3-97ba-4e56-a163-a94064ad64f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:16:39.479038 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: [pid: 88551|app: 0|req: 496/1005] 10.222.0.26 () {58 vars in 1024 bytes} [Wed Aug 17 19:16:39 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 19:16:39.819972 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0d7c687-0ac2-49bc-90b0-30ec49933377 None None] Authenticating user token {{(pid=88550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:16:39.835249 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0d7c687-0ac2-49bc-90b0-30ec49933377 None None] Validating token access rules against request {{(pid=88550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:16:39.841342 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3847f73a-bf32-4e9c-9c77-690760e743a3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ae23e7a10d54989a25c9f3019184d01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4bbf6c5abd684d899d09a08b0847d81c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:16:39.842270 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3847f73a-bf32-4e9c-9c77-690760e743a3 service nova] REQUEST_METHOD: `GET` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:16:39.842759 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3847f73a-bf32-4e9c-9c77-690760e743a3 service nova] SCRIPT_NAME: `/identity` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:16:39.843402 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3847f73a-bf32-4e9c-9c77-690760e743a3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:16:39.854890 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3847f73a-bf32-4e9c-9c77-690760e743a3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:16:39.856528 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3847f73a-bf32-4e9c-9c77-690760e743a3 service nova] RBAC: Authorization granted {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:16:39.867466 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: [pid: 88550|app: 0|req: 510/1006] 10.222.0.26 () {60 vars in 1365 bytes} [Wed Aug 17 19:16:39 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 19:16:42.130586 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf7bfc0-9fb4-4c23-bbed-b3ae67235790 None None] REQUEST_METHOD: `GET` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:16:42.131246 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf7bfc0-9fb4-4c23-bbed-b3ae67235790 None None] SCRIPT_NAME: `/identity` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:16:42.131739 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf7bfc0-9fb4-4c23-bbed-b3ae67235790 None None] PATH_INFO: `/` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:16:42.135008 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: [pid: 88551|app: 0|req: 497/1007] 10.222.0.26 () {54 vars in 927 bytes} [Wed Aug 17 19:16:42 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 19:16:42.142872 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-890e7bec-0ee2-4362-a72e-f088b5947581 None None] REQUEST_METHOD: `POST` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:16:42.143467 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-890e7bec-0ee2-4362-a72e-f088b5947581 None None] SCRIPT_NAME: `/identity` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:16:42.145730 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-890e7bec-0ee2-4362-a72e-f088b5947581 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:16:42.170916 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.auth.core [None req-890e7bec-0ee2-4362-a72e-f088b5947581 None None] MFA Rules not processed for user `819d41a279e64291acc60de51e1530ae`. Rule list: `[]` (Enabled: `True`). {{(pid=88550) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 19:16:42.172523 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.common.fernet_utils [None req-890e7bec-0ee2-4362-a72e-f088b5947581 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:16:42.183310 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: [pid: 88550|app: 0|req: 511/1008] 10.222.0.26 () {58 vars in 1024 bytes} [Wed Aug 17 19:16:42 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 17 19:16:42.545269 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bf7bfc0-9fb4-4c23-bbed-b3ae67235790 None None] Authenticating user token {{(pid=88551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:16:42.561735 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bf7bfc0-9fb4-4c23-bbed-b3ae67235790 None None] Validating token access rules against request {{(pid=88551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:16:42.568632 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ede9abc-5395-4ed3-9df7-350c2cfa2e3c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ae23e7a10d54989a25c9f3019184d01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4bbf6c5abd684d899d09a08b0847d81c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:16:42.569308 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ede9abc-5395-4ed3-9df7-350c2cfa2e3c service nova] REQUEST_METHOD: `GET` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:16:42.569672 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ede9abc-5395-4ed3-9df7-350c2cfa2e3c service nova] SCRIPT_NAME: `/identity` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:16:42.570146 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ede9abc-5395-4ed3-9df7-350c2cfa2e3c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:16:42.580708 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ede9abc-5395-4ed3-9df7-350c2cfa2e3c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:16:42.582808 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ede9abc-5395-4ed3-9df7-350c2cfa2e3c service nova] RBAC: Authorization granted {{(pid=88551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:16:42.594372 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: [pid: 88551|app: 0|req: 498/1009] 10.222.0.26 () {60 vars in 1365 bytes} [Wed Aug 17 19:16:42 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 19:16:46.066153 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d4c8111-e4f8-44e5-9805-5c9ef3576eb0 None None] REQUEST_METHOD: `GET` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:16:46.066869 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d4c8111-e4f8-44e5-9805-5c9ef3576eb0 None None] SCRIPT_NAME: `/identity` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:16:46.066869 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d4c8111-e4f8-44e5-9805-5c9ef3576eb0 None None] PATH_INFO: `/` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:16:46.068216 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: [pid: 88550|app: 0|req: 512/1010] 10.222.0.26 () {54 vars in 927 bytes} [Wed Aug 17 19:16:46 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 17 19:16:46.074334 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d93e3378-d310-48d6-b720-c75850585331 None None] REQUEST_METHOD: `POST` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:16:46.075169 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d93e3378-d310-48d6-b720-c75850585331 None None] SCRIPT_NAME: `/identity` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:16:46.075341 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d93e3378-d310-48d6-b720-c75850585331 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:16:46.083495 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG dbcounter [-] [88551] Writing DB stats keystone:SELECT=43 {{(pid=88551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:16:46.097093 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.auth.core [None req-d93e3378-d310-48d6-b720-c75850585331 None None] MFA Rules not processed for user `819d41a279e64291acc60de51e1530ae`. Rule list: `[]` (Enabled: `True`). {{(pid=88551) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 19:16:46.099058 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.common.fernet_utils [None req-d93e3378-d310-48d6-b720-c75850585331 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:16:46.111389 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: [pid: 88551|app: 0|req: 499/1011] 10.222.0.26 () {58 vars in 1024 bytes} [Wed Aug 17 19:16:46 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 17 19:16:46.659794 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d4c8111-e4f8-44e5-9805-5c9ef3576eb0 None None] Authenticating user token {{(pid=88550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:16:46.662949 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d4c8111-e4f8-44e5-9805-5c9ef3576eb0 None None] Validating token access rules against request {{(pid=88550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:16:46.668986 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-091db886-723e-4299-af3a-5dfd7c7a3d04 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ae23e7a10d54989a25c9f3019184d01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4bbf6c5abd684d899d09a08b0847d81c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:16:46.669758 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-091db886-723e-4299-af3a-5dfd7c7a3d04 service nova] REQUEST_METHOD: `GET` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:16:46.670136 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-091db886-723e-4299-af3a-5dfd7c7a3d04 service nova] SCRIPT_NAME: `/identity` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:16:46.670572 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-091db886-723e-4299-af3a-5dfd7c7a3d04 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:16:46.681091 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-091db886-723e-4299-af3a-5dfd7c7a3d04 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:16:46.682850 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-091db886-723e-4299-af3a-5dfd7c7a3d04 service nova] RBAC: Authorization granted {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:16:46.694968 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: [pid: 88550|app: 0|req: 513/1012] 10.222.0.26 () {60 vars in 1365 bytes} [Wed Aug 17 19:16:46 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 19:16:49.583592 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-086decba-4ca3-48df-839a-657826ee24b9 None None] REQUEST_METHOD: `GET` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:16:49.587190 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-086decba-4ca3-48df-839a-657826ee24b9 None None] SCRIPT_NAME: `/identity` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:16:49.587190 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-086decba-4ca3-48df-839a-657826ee24b9 None None] PATH_INFO: `/` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:16:49.587190 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: [pid: 88551|app: 0|req: 500/1013] 10.222.0.26 () {54 vars in 927 bytes} [Wed Aug 17 19:16:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 19:16:49.590937 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-857dca58-7fa2-4840-b70b-ba5ddac58888 None None] REQUEST_METHOD: `POST` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:16:49.591525 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-857dca58-7fa2-4840-b70b-ba5ddac58888 None None] SCRIPT_NAME: `/identity` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:16:49.591525 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-857dca58-7fa2-4840-b70b-ba5ddac58888 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:16:49.612342 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.auth.core [None req-857dca58-7fa2-4840-b70b-ba5ddac58888 None None] MFA Rules not processed for user `819d41a279e64291acc60de51e1530ae`. Rule list: `[]` (Enabled: `True`). {{(pid=88550) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 19:16:49.613552 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.common.fernet_utils [None req-857dca58-7fa2-4840-b70b-ba5ddac58888 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:16:49.622116 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: [pid: 88550|app: 0|req: 514/1014] 10.222.0.26 () {58 vars in 1024 bytes} [Wed Aug 17 19:16:49 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 19:16:49.975899 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-086decba-4ca3-48df-839a-657826ee24b9 None None] Authenticating user token {{(pid=88551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:16:49.991773 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-086decba-4ca3-48df-839a-657826ee24b9 None None] Validating token access rules against request {{(pid=88551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:16:49.997148 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1beae2c-d2ca-47a7-8ac3-2beba813b079 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ae23e7a10d54989a25c9f3019184d01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4bbf6c5abd684d899d09a08b0847d81c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:16:49.997867 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1beae2c-d2ca-47a7-8ac3-2beba813b079 service nova] REQUEST_METHOD: `GET` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:16:49.998146 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1beae2c-d2ca-47a7-8ac3-2beba813b079 service nova] SCRIPT_NAME: `/identity` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:16:49.998417 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1beae2c-d2ca-47a7-8ac3-2beba813b079 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:16:50.007642 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1beae2c-d2ca-47a7-8ac3-2beba813b079 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:16:50.009353 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1beae2c-d2ca-47a7-8ac3-2beba813b079 service nova] RBAC: Authorization granted {{(pid=88551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:16:50.020209 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: [pid: 88551|app: 0|req: 501/1015] 10.222.0.26 () {60 vars in 1365 bytes} [Wed Aug 17 19:16:49 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 19:16:51.425046 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d53abddf-d783-4d2a-a402-fc1ee9000390 None None] REQUEST_METHOD: `GET` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:16:51.430972 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d53abddf-d783-4d2a-a402-fc1ee9000390 None None] SCRIPT_NAME: `/identity` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:16:51.430972 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d53abddf-d783-4d2a-a402-fc1ee9000390 None None] PATH_INFO: `/` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:16:51.430972 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: [pid: 88550|app: 0|req: 515/1016] 10.222.0.26 () {54 vars in 927 bytes} [Wed Aug 17 19:16:51 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 19:16:51.433862 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38750aa1-bce1-458c-a43f-dafb073d0fd3 None None] REQUEST_METHOD: `POST` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:16:51.434449 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38750aa1-bce1-458c-a43f-dafb073d0fd3 None None] SCRIPT_NAME: `/identity` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:16:51.434449 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38750aa1-bce1-458c-a43f-dafb073d0fd3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:16:51.456274 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.auth.core [None req-38750aa1-bce1-458c-a43f-dafb073d0fd3 None None] MFA Rules not processed for user `819d41a279e64291acc60de51e1530ae`. Rule list: `[]` (Enabled: `True`). {{(pid=88551) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 19:16:51.459545 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.common.fernet_utils [None req-38750aa1-bce1-458c-a43f-dafb073d0fd3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:16:51.466693 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: [pid: 88551|app: 0|req: 502/1017] 10.222.0.26 () {58 vars in 1024 bytes} [Wed Aug 17 19:16:51 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 17 19:16:51.824302 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecef948c-f37c-487c-9d71-98cf13f3cd3d None None] REQUEST_METHOD: `GET` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:16:51.824587 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecef948c-f37c-487c-9d71-98cf13f3cd3d None None] SCRIPT_NAME: `/identity` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:16:51.824866 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecef948c-f37c-487c-9d71-98cf13f3cd3d None None] PATH_INFO: `/` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:16:51.826215 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: [pid: 88550|app: 0|req: 516/1018] 10.222.0.26 () {54 vars in 967 bytes} [Wed Aug 17 19:16:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 19:16:51.831618 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b314e769-a45e-481a-bee9-4b73df5910f2 None None] REQUEST_METHOD: `POST` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:16:51.831903 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b314e769-a45e-481a-bee9-4b73df5910f2 None None] SCRIPT_NAME: `/identity` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:16:51.832179 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b314e769-a45e-481a-bee9-4b73df5910f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:16:51.894299 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.auth.core [None req-b314e769-a45e-481a-bee9-4b73df5910f2 None None] MFA Rules not processed for user `5f32f6111c1c4f1f86c2185bde99a368`. Rule list: `[]` (Enabled: `True`). {{(pid=88551) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 19:16:51.896398 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.common.fernet_utils [None req-b314e769-a45e-481a-bee9-4b73df5910f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:16:51.978366 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: [pid: 88551|app: 0|req: 503/1019] 10.222.0.26 () {58 vars in 1064 bytes} [Wed Aug 17 19:16:51 2022] POST /identity/v3/auth/tokens => generated 2680 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 17 19:16:51.985699 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecef948c-f37c-487c-9d71-98cf13f3cd3d None None] Authenticating user token {{(pid=88550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:16:51.996796 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecef948c-f37c-487c-9d71-98cf13f3cd3d None None] Validating token access rules against request {{(pid=88550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:16:52.000380 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aa739a3-7a95-48ee-9500-3d2d9a0d0ad5 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f32f6111c1c4f1f86c2185bde99a368', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4bbf6c5abd684d899d09a08b0847d81c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:16:52.001012 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa739a3-7a95-48ee-9500-3d2d9a0d0ad5 service glance] REQUEST_METHOD: `GET` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:16:52.001328 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa739a3-7a95-48ee-9500-3d2d9a0d0ad5 service glance] SCRIPT_NAME: `/identity` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:16:52.001638 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa739a3-7a95-48ee-9500-3d2d9a0d0ad5 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:16:52.010841 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aa739a3-7a95-48ee-9500-3d2d9a0d0ad5 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:16:52.012311 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aa739a3-7a95-48ee-9500-3d2d9a0d0ad5 service glance] RBAC: Authorization granted {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:16:52.021949 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: [pid: 88550|app: 0|req: 517/1020] 10.222.0.26 () {60 vars in 1365 bytes} [Wed Aug 17 19:16:51 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 19:16:52.443166 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89918985-dbe1-4b4b-a83e-5849fe1d4832 None None] REQUEST_METHOD: `GET` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:16:52.443776 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89918985-dbe1-4b4b-a83e-5849fe1d4832 None None] SCRIPT_NAME: `/identity` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:16:52.443776 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89918985-dbe1-4b4b-a83e-5849fe1d4832 None None] PATH_INFO: `/` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:16:52.445035 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: [pid: 88551|app: 0|req: 504/1021] 10.222.0.26 () {54 vars in 927 bytes} [Wed Aug 17 19:16:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 19:16:52.450222 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-473854f8-99b4-429e-8f23-33e0fe0e99ae None None] REQUEST_METHOD: `POST` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:16:52.450730 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-473854f8-99b4-429e-8f23-33e0fe0e99ae None None] SCRIPT_NAME: `/identity` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:16:52.450819 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-473854f8-99b4-429e-8f23-33e0fe0e99ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:16:52.471868 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.auth.core [None req-473854f8-99b4-429e-8f23-33e0fe0e99ae None None] MFA Rules not processed for user `819d41a279e64291acc60de51e1530ae`. Rule list: `[]` (Enabled: `True`). {{(pid=88550) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 19:16:52.473068 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.common.fernet_utils [None req-473854f8-99b4-429e-8f23-33e0fe0e99ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:16:52.480867 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: [pid: 88550|app: 0|req: 518/1022] 10.222.0.26 () {58 vars in 1024 bytes} [Wed Aug 17 19:16:52 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 19:16:52.830908 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89918985-dbe1-4b4b-a83e-5849fe1d4832 None None] Authenticating user token {{(pid=88551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:16:52.846951 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89918985-dbe1-4b4b-a83e-5849fe1d4832 None None] Validating token access rules against request {{(pid=88551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:16:52.852121 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58ed0471-3c93-4ddc-aaaa-997daea25b86 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ae23e7a10d54989a25c9f3019184d01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4bbf6c5abd684d899d09a08b0847d81c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:16:52.852715 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ed0471-3c93-4ddc-aaaa-997daea25b86 service nova] REQUEST_METHOD: `GET` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:16:52.852991 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ed0471-3c93-4ddc-aaaa-997daea25b86 service nova] SCRIPT_NAME: `/identity` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:16:52.853259 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ed0471-3c93-4ddc-aaaa-997daea25b86 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:16:52.862788 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58ed0471-3c93-4ddc-aaaa-997daea25b86 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:16:52.864382 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58ed0471-3c93-4ddc-aaaa-997daea25b86 service nova] RBAC: Authorization granted {{(pid=88551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:16:52.874654 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: [pid: 88551|app: 0|req: 505/1023] 10.222.0.26 () {60 vars in 1365 bytes} [Wed Aug 17 19:16:52 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 17 19:16:55.538702 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc5dfd7-e06f-43e2-bb41-045a1a014804 None None] REQUEST_METHOD: `GET` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:16:55.539635 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc5dfd7-e06f-43e2-bb41-045a1a014804 None None] SCRIPT_NAME: `/identity` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:16:55.539635 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc5dfd7-e06f-43e2-bb41-045a1a014804 None None] PATH_INFO: `/` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:16:55.540459 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: [pid: 88550|app: 0|req: 519/1024] 10.222.0.26 () {54 vars in 927 bytes} [Wed Aug 17 19:16:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 17 19:16:55.546588 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-189a0c65-2b30-496b-a2c0-a58b1331410f None None] REQUEST_METHOD: `POST` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:16:55.549939 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-189a0c65-2b30-496b-a2c0-a58b1331410f None None] SCRIPT_NAME: `/identity` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:16:55.549939 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-189a0c65-2b30-496b-a2c0-a58b1331410f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:16:55.579038 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.auth.core [None req-189a0c65-2b30-496b-a2c0-a58b1331410f None None] MFA Rules not processed for user `819d41a279e64291acc60de51e1530ae`. Rule list: `[]` (Enabled: `True`). {{(pid=88551) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 19:16:55.581557 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.common.fernet_utils [None req-189a0c65-2b30-496b-a2c0-a58b1331410f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:16:55.595252 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: [pid: 88551|app: 0|req: 506/1025] 10.222.0.26 () {58 vars in 1024 bytes} [Wed Aug 17 19:16:55 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 19:16:56.008789 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddc5dfd7-e06f-43e2-bb41-045a1a014804 None None] Authenticating user token {{(pid=88550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:16:56.030012 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddc5dfd7-e06f-43e2-bb41-045a1a014804 None None] Validating token access rules against request {{(pid=88550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:16:56.037192 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9273483e-716c-4b83-9f71-6b6d1fe962f5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ae23e7a10d54989a25c9f3019184d01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4bbf6c5abd684d899d09a08b0847d81c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:16:56.037946 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9273483e-716c-4b83-9f71-6b6d1fe962f5 service nova] REQUEST_METHOD: `GET` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:16:56.038330 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9273483e-716c-4b83-9f71-6b6d1fe962f5 service nova] SCRIPT_NAME: `/identity` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:16:56.038750 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9273483e-716c-4b83-9f71-6b6d1fe962f5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:16:56.052619 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9273483e-716c-4b83-9f71-6b6d1fe962f5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:16:56.054425 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9273483e-716c-4b83-9f71-6b6d1fe962f5 service nova] RBAC: Authorization granted {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:16:56.066826 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: [pid: 88550|app: 0|req: 520/1026] 10.222.0.26 () {60 vars in 1365 bytes} [Wed Aug 17 19:16:56 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 59 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 19:17:05.571471 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG dbcounter [-] [88551] Writing DB stats keystone:SELECT=58 {{(pid=88551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:17:06.061459 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG dbcounter [-] [88550] Writing DB stats keystone:SELECT=34 {{(pid=88550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:17:09.188138 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b12f5aba-4151-4034-b0f5-b6796e800f78 None None] REQUEST_METHOD: `GET` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:17:09.188853 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b12f5aba-4151-4034-b0f5-b6796e800f78 None None] SCRIPT_NAME: `/identity` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:17:09.188853 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b12f5aba-4151-4034-b0f5-b6796e800f78 None None] PATH_INFO: `/` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:17:09.190040 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: [pid: 88551|app: 0|req: 507/1027] 10.222.0.26 () {54 vars in 918 bytes} [Wed Aug 17 19:17:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 19:17:09.195796 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1bf0cf1-1d57-436d-a766-6bc754985bd6 None None] REQUEST_METHOD: `POST` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:17:09.196563 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1bf0cf1-1d57-436d-a766-6bc754985bd6 None None] SCRIPT_NAME: `/identity` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:17:09.196563 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1bf0cf1-1d57-436d-a766-6bc754985bd6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:17:09.222994 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.auth.core [None req-d1bf0cf1-1d57-436d-a766-6bc754985bd6 None None] MFA Rules not processed for user `6478a47e33024d1abc99f078dbc30787`. Rule list: `[]` (Enabled: `True`). {{(pid=88550) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 19:17:09.224388 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.common.fernet_utils [None req-d1bf0cf1-1d57-436d-a766-6bc754985bd6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:17:09.233523 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: [pid: 88550|app: 0|req: 521/1028] 10.222.0.26 () {58 vars in 1015 bytes} [Wed Aug 17 19:17:09 2022] POST /identity/v3/auth/tokens => generated 2868 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 19:17:09.249160 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e56b069-e8c1-470b-b5ca-134c78fa8ed5 None None] REQUEST_METHOD: `GET` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:17:09.249481 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e56b069-e8c1-470b-b5ca-134c78fa8ed5 None None] SCRIPT_NAME: `/identity` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:17:09.249797 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e56b069-e8c1-470b-b5ca-134c78fa8ed5 None None] PATH_INFO: `/` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:17:09.251794 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: [pid: 88551|app: 0|req: 508/1029] 10.222.0.26 () {54 vars in 918 bytes} [Wed Aug 17 19:17:09 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 19:17:09.257879 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3985f1af-bad2-487f-a9da-cf24edfcd84d None None] REQUEST_METHOD: `POST` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:17:09.258317 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3985f1af-bad2-487f-a9da-cf24edfcd84d None None] SCRIPT_NAME: `/identity` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:17:09.258729 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3985f1af-bad2-487f-a9da-cf24edfcd84d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:17:09.295329 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.auth.core [None req-3985f1af-bad2-487f-a9da-cf24edfcd84d None None] MFA Rules not processed for user `9ae23e7a10d54989a25c9f3019184d01`. Rule list: `[]` (Enabled: `True`). {{(pid=88550) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 19:17:09.296576 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.common.fernet_utils [None req-3985f1af-bad2-487f-a9da-cf24edfcd84d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:17:09.305450 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: [pid: 88550|app: 0|req: 522/1030] 10.222.0.26 () {58 vars in 1015 bytes} [Wed Aug 17 19:17:09 2022] POST /identity/v3/auth/tokens => generated 2863 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 17 19:17:12.410806 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56041402-f7fe-4db0-8a24-07b2408c2a78 None None] REQUEST_METHOD: `GET` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:17:12.411495 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56041402-f7fe-4db0-8a24-07b2408c2a78 None None] SCRIPT_NAME: `/identity` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:17:12.411495 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56041402-f7fe-4db0-8a24-07b2408c2a78 None None] PATH_INFO: `/` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:17:12.412739 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: [pid: 88551|app: 0|req: 509/1031] 127.0.0.1 () {54 vars in 917 bytes} [Wed Aug 17 19:17:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 19:17:12.418756 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b1f146-8a9a-45d2-b8bb-8bbf488a3cb2 None None] REQUEST_METHOD: `POST` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:17:12.419682 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b1f146-8a9a-45d2-b8bb-8bbf488a3cb2 None None] SCRIPT_NAME: `/identity` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:17:12.419682 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b1f146-8a9a-45d2-b8bb-8bbf488a3cb2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:17:12.445881 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.auth.core [None req-e3b1f146-8a9a-45d2-b8bb-8bbf488a3cb2 None None] MFA Rules not processed for user `819d41a279e64291acc60de51e1530ae`. Rule list: `[]` (Enabled: `True`). {{(pid=88550) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 19:17:12.447891 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.common.fernet_utils [None req-e3b1f146-8a9a-45d2-b8bb-8bbf488a3cb2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:17:12.461806 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: [pid: 88550|app: 0|req: 523/1032] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Aug 17 19:17:12 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 17 19:17:12.814507 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56041402-f7fe-4db0-8a24-07b2408c2a78 None None] Authenticating user token {{(pid=88551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:17:12.828675 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56041402-f7fe-4db0-8a24-07b2408c2a78 None None] Validating token access rules against request {{(pid=88551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:17:12.834299 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ebf7108-6c2e-4e17-8d87-66063b5a16cd service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ae23e7a10d54989a25c9f3019184d01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4bbf6c5abd684d899d09a08b0847d81c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:17:12.834950 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ebf7108-6c2e-4e17-8d87-66063b5a16cd service nova] REQUEST_METHOD: `GET` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:17:12.835233 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ebf7108-6c2e-4e17-8d87-66063b5a16cd service nova] SCRIPT_NAME: `/identity` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:17:12.835515 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ebf7108-6c2e-4e17-8d87-66063b5a16cd service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:17:12.845058 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ebf7108-6c2e-4e17-8d87-66063b5a16cd service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:17:12.846708 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ebf7108-6c2e-4e17-8d87-66063b5a16cd service nova] RBAC: Authorization granted {{(pid=88551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:17:12.857666 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: [pid: 88551|app: 0|req: 510/1033] 10.222.0.26 () {60 vars in 1365 bytes} [Wed Aug 17 19:17:12 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 17 19:17:13.858058 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1016335-5780-4081-8276-92be74174285 None None] REQUEST_METHOD: `GET` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:17:13.858680 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1016335-5780-4081-8276-92be74174285 None None] SCRIPT_NAME: `/identity` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:17:13.858680 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1016335-5780-4081-8276-92be74174285 None None] PATH_INFO: `/` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:17:13.860011 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: [pid: 88550|app: 0|req: 524/1034] 127.0.0.1 () {54 vars in 901 bytes} [Wed Aug 17 19:17:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 19:17:13.868405 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-352837c4-0008-47e3-8f10-00d18ee3cc9f None None] REQUEST_METHOD: `POST` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:17:13.868940 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-352837c4-0008-47e3-8f10-00d18ee3cc9f None None] SCRIPT_NAME: `/identity` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:17:13.869280 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-352837c4-0008-47e3-8f10-00d18ee3cc9f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:17:13.899957 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.auth.core [None req-352837c4-0008-47e3-8f10-00d18ee3cc9f None None] MFA Rules not processed for user `819d41a279e64291acc60de51e1530ae`. Rule list: `[]` (Enabled: `True`). {{(pid=88551) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 19:17:13.901962 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.common.fernet_utils [None req-352837c4-0008-47e3-8f10-00d18ee3cc9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:17:13.916198 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: [pid: 88551|app: 0|req: 511/1035] 127.0.0.1 () {58 vars in 998 bytes} [Wed Aug 17 19:17:13 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 19:17:14.140819 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1016335-5780-4081-8276-92be74174285 None None] Authenticating user token {{(pid=88550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:17:14.155069 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1016335-5780-4081-8276-92be74174285 None None] Validating token access rules against request {{(pid=88550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:17:14.160181 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-020bfea0-b485-4092-9b4a-667562473802 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ae23e7a10d54989a25c9f3019184d01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4bbf6c5abd684d899d09a08b0847d81c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:17:14.160789 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-020bfea0-b485-4092-9b4a-667562473802 service nova] REQUEST_METHOD: `GET` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:17:14.161068 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-020bfea0-b485-4092-9b4a-667562473802 service nova] SCRIPT_NAME: `/identity` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:17:14.161340 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-020bfea0-b485-4092-9b4a-667562473802 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:17:14.170361 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-020bfea0-b485-4092-9b4a-667562473802 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:17:14.172028 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-020bfea0-b485-4092-9b4a-667562473802 service nova] RBAC: Authorization granted {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:17:14.182707 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: [pid: 88550|app: 0|req: 525/1036] 10.222.0.26 () {60 vars in 1365 bytes} [Wed Aug 17 19:17:14 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 19:17:15.202413 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4109d559-0a5b-4056-a02f-2ceeb2c84d1e None None] REQUEST_METHOD: `GET` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:17:15.203065 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4109d559-0a5b-4056-a02f-2ceeb2c84d1e None None] SCRIPT_NAME: `/identity` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:17:15.203065 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4109d559-0a5b-4056-a02f-2ceeb2c84d1e None None] PATH_INFO: `/` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:17:15.205034 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: [pid: 88551|app: 0|req: 512/1037] 127.0.0.1 () {54 vars in 901 bytes} [Wed Aug 17 19:17:15 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 19:17:15.210972 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2da4e1b-e43d-4645-b36f-86c0303d8a3f None None] REQUEST_METHOD: `POST` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:17:15.211812 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2da4e1b-e43d-4645-b36f-86c0303d8a3f None None] SCRIPT_NAME: `/identity` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:17:15.211975 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2da4e1b-e43d-4645-b36f-86c0303d8a3f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:17:15.233597 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.auth.core [None req-c2da4e1b-e43d-4645-b36f-86c0303d8a3f None None] MFA Rules not processed for user `819d41a279e64291acc60de51e1530ae`. Rule list: `[]` (Enabled: `True`). {{(pid=88550) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 19:17:15.234888 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.common.fernet_utils [None req-c2da4e1b-e43d-4645-b36f-86c0303d8a3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:17:15.243077 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: [pid: 88550|app: 0|req: 526/1038] 127.0.0.1 () {58 vars in 998 bytes} [Wed Aug 17 19:17:15 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 19:17:15.403401 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4109d559-0a5b-4056-a02f-2ceeb2c84d1e None None] Authenticating user token {{(pid=88551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:17:15.418156 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4109d559-0a5b-4056-a02f-2ceeb2c84d1e None None] Validating token access rules against request {{(pid=88551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:17:15.423291 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b20ad6dc-04df-4838-8429-ae021132655b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ae23e7a10d54989a25c9f3019184d01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4bbf6c5abd684d899d09a08b0847d81c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:17:15.423905 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b20ad6dc-04df-4838-8429-ae021132655b service nova] REQUEST_METHOD: `GET` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:17:15.424192 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b20ad6dc-04df-4838-8429-ae021132655b service nova] SCRIPT_NAME: `/identity` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:17:15.424459 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b20ad6dc-04df-4838-8429-ae021132655b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:17:15.436197 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b20ad6dc-04df-4838-8429-ae021132655b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:17:15.439643 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b20ad6dc-04df-4838-8429-ae021132655b service nova] RBAC: Authorization granted {{(pid=88551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:17:15.457913 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: [pid: 88551|app: 0|req: 513/1039] 10.222.0.26 () {60 vars in 1365 bytes} [Wed Aug 17 19:17:15 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 55 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 17 19:17:16.380336 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-802be1b5-ffc0-4edb-91d4-325fc93f7e4e None None] REQUEST_METHOD: `GET` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:17:16.380936 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-802be1b5-ffc0-4edb-91d4-325fc93f7e4e None None] SCRIPT_NAME: `/identity` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:17:16.381362 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-802be1b5-ffc0-4edb-91d4-325fc93f7e4e None None] PATH_INFO: `/` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:17:16.383945 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: [pid: 88550|app: 0|req: 527/1040] 127.0.0.1 () {54 vars in 901 bytes} [Wed Aug 17 19:17:16 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 19:17:16.393534 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deecf8e2-4818-4ad6-9c03-5a76aaaa47f7 None None] REQUEST_METHOD: `POST` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:17:16.393534 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deecf8e2-4818-4ad6-9c03-5a76aaaa47f7 None None] SCRIPT_NAME: `/identity` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:17:16.393534 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deecf8e2-4818-4ad6-9c03-5a76aaaa47f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:17:16.419136 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.auth.core [None req-deecf8e2-4818-4ad6-9c03-5a76aaaa47f7 None None] MFA Rules not processed for user `819d41a279e64291acc60de51e1530ae`. Rule list: `[]` (Enabled: `True`). {{(pid=88551) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 19:17:16.420376 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.common.fernet_utils [None req-deecf8e2-4818-4ad6-9c03-5a76aaaa47f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:17:16.429368 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: [pid: 88551|app: 0|req: 514/1041] 127.0.0.1 () {58 vars in 998 bytes} [Wed Aug 17 19:17:16 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 19:17:16.587656 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-802be1b5-ffc0-4edb-91d4-325fc93f7e4e None None] Authenticating user token {{(pid=88550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:17:16.602784 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-802be1b5-ffc0-4edb-91d4-325fc93f7e4e None None] Validating token access rules against request {{(pid=88550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:17:16.608012 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ded54e4-a850-434c-bd99-460302766c26 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ae23e7a10d54989a25c9f3019184d01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4bbf6c5abd684d899d09a08b0847d81c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:17:16.608665 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ded54e4-a850-434c-bd99-460302766c26 service nova] REQUEST_METHOD: `GET` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:17:16.608987 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ded54e4-a850-434c-bd99-460302766c26 service nova] SCRIPT_NAME: `/identity` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:17:16.609336 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ded54e4-a850-434c-bd99-460302766c26 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:17:16.619290 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ded54e4-a850-434c-bd99-460302766c26 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:17:16.620904 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ded54e4-a850-434c-bd99-460302766c26 service nova] RBAC: Authorization granted {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:17:16.639671 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: [pid: 88550|app: 0|req: 528/1042] 10.222.0.26 () {60 vars in 1365 bytes} [Wed Aug 17 19:17:16 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 17 19:17:17.566013 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd657dc6-de54-4e57-b4e4-ddc18be8d960 None None] REQUEST_METHOD: `GET` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:17:17.566650 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd657dc6-de54-4e57-b4e4-ddc18be8d960 None None] SCRIPT_NAME: `/identity` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:17:17.566650 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd657dc6-de54-4e57-b4e4-ddc18be8d960 None None] PATH_INFO: `/` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:17:17.567920 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: [pid: 88551|app: 0|req: 515/1043] 127.0.0.1 () {54 vars in 901 bytes} [Wed Aug 17 19:17:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 19:17:17.574251 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af2618c-e1ee-4434-b93d-b29b63128fb7 None None] REQUEST_METHOD: `POST` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:17:17.574806 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af2618c-e1ee-4434-b93d-b29b63128fb7 None None] SCRIPT_NAME: `/identity` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:17:17.575257 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af2618c-e1ee-4434-b93d-b29b63128fb7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:17:17.607414 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.auth.core [None req-5af2618c-e1ee-4434-b93d-b29b63128fb7 None None] MFA Rules not processed for user `819d41a279e64291acc60de51e1530ae`. Rule list: `[]` (Enabled: `True`). {{(pid=88550) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 19:17:17.609543 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.common.fernet_utils [None req-5af2618c-e1ee-4434-b93d-b29b63128fb7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:17:17.623890 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: [pid: 88550|app: 0|req: 529/1044] 127.0.0.1 () {58 vars in 998 bytes} [Wed Aug 17 19:17:17 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 19:17:17.785048 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd657dc6-de54-4e57-b4e4-ddc18be8d960 None None] Authenticating user token {{(pid=88551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:17:17.800331 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd657dc6-de54-4e57-b4e4-ddc18be8d960 None None] Validating token access rules against request {{(pid=88551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:17:17.805660 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c22ff7b5-c8ff-4344-8fad-46b637093101 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ae23e7a10d54989a25c9f3019184d01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4bbf6c5abd684d899d09a08b0847d81c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:17:17.806284 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c22ff7b5-c8ff-4344-8fad-46b637093101 service nova] REQUEST_METHOD: `GET` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:17:17.806593 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c22ff7b5-c8ff-4344-8fad-46b637093101 service nova] SCRIPT_NAME: `/identity` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:17:17.806870 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c22ff7b5-c8ff-4344-8fad-46b637093101 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:17:17.816970 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c22ff7b5-c8ff-4344-8fad-46b637093101 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:17:17.818529 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c22ff7b5-c8ff-4344-8fad-46b637093101 service nova] RBAC: Authorization granted {{(pid=88551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:17:17.829747 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: [pid: 88551|app: 0|req: 516/1045] 10.222.0.26 () {60 vars in 1365 bytes} [Wed Aug 17 19:17:17 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 19:17:18.734976 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-454d2f0f-6353-468f-ba21-18ae5427652a None None] REQUEST_METHOD: `GET` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:17:18.736080 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-454d2f0f-6353-468f-ba21-18ae5427652a None None] SCRIPT_NAME: `/identity` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:17:18.736080 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-454d2f0f-6353-468f-ba21-18ae5427652a None None] PATH_INFO: `/` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:17:18.737461 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: [pid: 88550|app: 0|req: 530/1046] 127.0.0.1 () {54 vars in 901 bytes} [Wed Aug 17 19:17:18 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 17 19:17:18.743459 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-428351c5-799b-432f-8507-c929c253902b None None] REQUEST_METHOD: `POST` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:17:18.744268 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-428351c5-799b-432f-8507-c929c253902b None None] SCRIPT_NAME: `/identity` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:17:18.744472 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-428351c5-799b-432f-8507-c929c253902b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:17:18.767011 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.auth.core [None req-428351c5-799b-432f-8507-c929c253902b None None] MFA Rules not processed for user `819d41a279e64291acc60de51e1530ae`. Rule list: `[]` (Enabled: `True`). {{(pid=88551) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 19:17:18.768259 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.common.fernet_utils [None req-428351c5-799b-432f-8507-c929c253902b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:17:18.776420 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: [pid: 88551|app: 0|req: 517/1047] 127.0.0.1 () {58 vars in 998 bytes} [Wed Aug 17 19:17:18 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 17 19:17:19.069652 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-454d2f0f-6353-468f-ba21-18ae5427652a None None] Authenticating user token {{(pid=88550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:17:19.083516 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-454d2f0f-6353-468f-ba21-18ae5427652a None None] Validating token access rules against request {{(pid=88550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:17:19.089012 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4faae09c-fb4c-450d-8e8b-bbe396467f99 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ae23e7a10d54989a25c9f3019184d01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4bbf6c5abd684d899d09a08b0847d81c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:17:19.089619 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4faae09c-fb4c-450d-8e8b-bbe396467f99 service nova] REQUEST_METHOD: `GET` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:17:19.089899 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4faae09c-fb4c-450d-8e8b-bbe396467f99 service nova] SCRIPT_NAME: `/identity` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:17:19.090170 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4faae09c-fb4c-450d-8e8b-bbe396467f99 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:17:19.099235 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4faae09c-fb4c-450d-8e8b-bbe396467f99 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:17:19.100836 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4faae09c-fb4c-450d-8e8b-bbe396467f99 service nova] RBAC: Authorization granted {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:17:19.112254 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: [pid: 88550|app: 0|req: 531/1048] 10.222.0.26 () {60 vars in 1365 bytes} [Wed Aug 17 19:17:19 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 19:17:20.059137 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b2adfd-e9a9-491a-a4ef-891a2f7cac42 None None] REQUEST_METHOD: `GET` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:17:20.059920 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b2adfd-e9a9-491a-a4ef-891a2f7cac42 None None] SCRIPT_NAME: `/identity` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:17:20.059920 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b2adfd-e9a9-491a-a4ef-891a2f7cac42 None None] PATH_INFO: `/` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:17:20.061041 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: [pid: 88551|app: 0|req: 518/1049] 127.0.0.1 () {54 vars in 901 bytes} [Wed Aug 17 19:17:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 19:17:20.067290 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea8f2d99-767c-4fa6-b966-f3bc0a36a310 None None] REQUEST_METHOD: `POST` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:17:20.067813 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea8f2d99-767c-4fa6-b966-f3bc0a36a310 None None] SCRIPT_NAME: `/identity` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:17:20.067813 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea8f2d99-767c-4fa6-b966-f3bc0a36a310 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:17:20.088971 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.auth.core [None req-ea8f2d99-767c-4fa6-b966-f3bc0a36a310 None None] MFA Rules not processed for user `819d41a279e64291acc60de51e1530ae`. Rule list: `[]` (Enabled: `True`). {{(pid=88550) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 19:17:20.090356 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.common.fernet_utils [None req-ea8f2d99-767c-4fa6-b966-f3bc0a36a310 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:17:20.099155 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: [pid: 88550|app: 0|req: 532/1050] 127.0.0.1 () {58 vars in 998 bytes} [Wed Aug 17 19:17:20 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 17 19:17:20.259153 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3b2adfd-e9a9-491a-a4ef-891a2f7cac42 None None] Authenticating user token {{(pid=88551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:17:20.273937 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3b2adfd-e9a9-491a-a4ef-891a2f7cac42 None None] Validating token access rules against request {{(pid=88551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:17:20.279226 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12e2fd7a-b1f7-4ebf-8404-2f5cb70176e3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ae23e7a10d54989a25c9f3019184d01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4bbf6c5abd684d899d09a08b0847d81c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:17:20.279827 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e2fd7a-b1f7-4ebf-8404-2f5cb70176e3 service nova] REQUEST_METHOD: `GET` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:17:20.280115 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e2fd7a-b1f7-4ebf-8404-2f5cb70176e3 service nova] SCRIPT_NAME: `/identity` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:17:20.280378 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e2fd7a-b1f7-4ebf-8404-2f5cb70176e3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:17:20.289386 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12e2fd7a-b1f7-4ebf-8404-2f5cb70176e3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:17:20.291017 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12e2fd7a-b1f7-4ebf-8404-2f5cb70176e3 service nova] RBAC: Authorization granted {{(pid=88551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:17:20.301210 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: [pid: 88551|app: 0|req: 519/1051] 10.222.0.26 () {60 vars in 1365 bytes} [Wed Aug 17 19:17:20 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 17 19:17:21.206905 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df54b0c-8beb-44cb-a6e0-ebe625d68dc9 None None] REQUEST_METHOD: `GET` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:17:21.207480 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df54b0c-8beb-44cb-a6e0-ebe625d68dc9 None None] SCRIPT_NAME: `/identity` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:17:21.207480 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df54b0c-8beb-44cb-a6e0-ebe625d68dc9 None None] PATH_INFO: `/` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:17:21.209067 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: [pid: 88550|app: 0|req: 533/1052] 127.0.0.1 () {54 vars in 901 bytes} [Wed Aug 17 19:17:21 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 17 19:17:21.214778 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f79ea4-965d-4622-99e6-db3643ba2ef0 None None] REQUEST_METHOD: `POST` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:17:21.215295 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f79ea4-965d-4622-99e6-db3643ba2ef0 None None] SCRIPT_NAME: `/identity` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:17:21.215375 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f79ea4-965d-4622-99e6-db3643ba2ef0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:17:21.236430 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.auth.core [None req-31f79ea4-965d-4622-99e6-db3643ba2ef0 None None] MFA Rules not processed for user `819d41a279e64291acc60de51e1530ae`. Rule list: `[]` (Enabled: `True`). {{(pid=88551) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 19:17:21.237969 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.common.fernet_utils [None req-31f79ea4-965d-4622-99e6-db3643ba2ef0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:17:21.246363 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: [pid: 88551|app: 0|req: 520/1053] 127.0.0.1 () {58 vars in 998 bytes} [Wed Aug 17 19:17:21 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 19:17:21.418935 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7df54b0c-8beb-44cb-a6e0-ebe625d68dc9 None None] Authenticating user token {{(pid=88550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:17:21.434112 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7df54b0c-8beb-44cb-a6e0-ebe625d68dc9 None None] Validating token access rules against request {{(pid=88550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:17:21.442234 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44f84503-bd6f-4f2b-a362-e109695ff710 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ae23e7a10d54989a25c9f3019184d01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4bbf6c5abd684d899d09a08b0847d81c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:17:21.443093 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f84503-bd6f-4f2b-a362-e109695ff710 service nova] REQUEST_METHOD: `GET` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:17:21.443549 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f84503-bd6f-4f2b-a362-e109695ff710 service nova] SCRIPT_NAME: `/identity` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:17:21.444027 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f84503-bd6f-4f2b-a362-e109695ff710 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:17:21.453716 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44f84503-bd6f-4f2b-a362-e109695ff710 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:17:21.456008 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44f84503-bd6f-4f2b-a362-e109695ff710 service nova] RBAC: Authorization granted {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:17:21.466982 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: [pid: 88550|app: 0|req: 534/1054] 10.222.0.26 () {60 vars in 1365 bytes} [Wed Aug 17 19:17:21 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 19:17:22.361855 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd98f30-58ac-443e-bea7-ab69d3a7aec5 None None] REQUEST_METHOD: `GET` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:17:22.362441 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd98f30-58ac-443e-bea7-ab69d3a7aec5 None None] SCRIPT_NAME: `/identity` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:17:22.362441 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd98f30-58ac-443e-bea7-ab69d3a7aec5 None None] PATH_INFO: `/` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:17:22.363808 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: [pid: 88551|app: 0|req: 521/1055] 127.0.0.1 () {54 vars in 901 bytes} [Wed Aug 17 19:17:22 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 17 19:17:22.369414 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6059be6-33b0-4253-aaac-d4b58cd6f431 None None] REQUEST_METHOD: `POST` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:17:22.369945 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6059be6-33b0-4253-aaac-d4b58cd6f431 None None] SCRIPT_NAME: `/identity` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:17:22.369945 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6059be6-33b0-4253-aaac-d4b58cd6f431 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:17:22.390191 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.auth.core [None req-d6059be6-33b0-4253-aaac-d4b58cd6f431 None None] MFA Rules not processed for user `819d41a279e64291acc60de51e1530ae`. Rule list: `[]` (Enabled: `True`). {{(pid=88550) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 19:17:22.391473 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.common.fernet_utils [None req-d6059be6-33b0-4253-aaac-d4b58cd6f431 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:17:22.399660 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: [pid: 88550|app: 0|req: 535/1056] 127.0.0.1 () {58 vars in 998 bytes} [Wed Aug 17 19:17:22 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 19:17:22.562678 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bd98f30-58ac-443e-bea7-ab69d3a7aec5 None None] Authenticating user token {{(pid=88551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:17:22.577085 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bd98f30-58ac-443e-bea7-ab69d3a7aec5 None None] Validating token access rules against request {{(pid=88551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:17:22.582566 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77dea745-afa9-4781-841b-b125b248d1c5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ae23e7a10d54989a25c9f3019184d01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4bbf6c5abd684d899d09a08b0847d81c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:17:22.583223 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77dea745-afa9-4781-841b-b125b248d1c5 service nova] REQUEST_METHOD: `GET` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:17:22.583541 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77dea745-afa9-4781-841b-b125b248d1c5 service nova] SCRIPT_NAME: `/identity` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:17:22.583852 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77dea745-afa9-4781-841b-b125b248d1c5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:17:22.592943 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77dea745-afa9-4781-841b-b125b248d1c5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:17:22.595152 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77dea745-afa9-4781-841b-b125b248d1c5 service nova] RBAC: Authorization granted {{(pid=88551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:17:22.605661 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: [pid: 88551|app: 0|req: 522/1057] 10.222.0.26 () {60 vars in 1365 bytes} [Wed Aug 17 19:17:22 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 17 19:17:24.765049 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e0771c0-0543-4c44-bb56-b19044136d59 None None] REQUEST_METHOD: `GET` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:17:24.765885 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e0771c0-0543-4c44-bb56-b19044136d59 None None] SCRIPT_NAME: `/identity` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:17:24.765885 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e0771c0-0543-4c44-bb56-b19044136d59 None None] PATH_INFO: `/` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:17:24.767511 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: [pid: 88550|app: 0|req: 536/1058] 127.0.0.1 () {54 vars in 917 bytes} [Wed Aug 17 19:17:24 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 17 19:17:24.773460 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0864f9e3-4d2c-4f1e-961f-3d63638fa4ec None None] REQUEST_METHOD: `POST` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:17:24.774202 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0864f9e3-4d2c-4f1e-961f-3d63638fa4ec None None] SCRIPT_NAME: `/identity` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:17:24.774202 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0864f9e3-4d2c-4f1e-961f-3d63638fa4ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:17:24.793895 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.auth.core [None req-0864f9e3-4d2c-4f1e-961f-3d63638fa4ec None None] MFA Rules not processed for user `819d41a279e64291acc60de51e1530ae`. Rule list: `[]` (Enabled: `True`). {{(pid=88551) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 19:17:24.795646 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.common.fernet_utils [None req-0864f9e3-4d2c-4f1e-961f-3d63638fa4ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:17:24.807479 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: [pid: 88551|app: 0|req: 523/1059] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Aug 17 19:17:24 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 17 19:17:25.154659 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e0771c0-0543-4c44-bb56-b19044136d59 None None] Authenticating user token {{(pid=88550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:17:25.166069 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e0771c0-0543-4c44-bb56-b19044136d59 None None] Validating token access rules against request {{(pid=88550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:17:25.169918 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cf7299c-7f95-4e54-8cec-c59ddeb67cc6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8240f6e0b65545708f07e040c09e1490', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4bbf6c5abd684d899d09a08b0847d81c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:17:25.170516 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf7299c-7f95-4e54-8cec-c59ddeb67cc6 service neutron] REQUEST_METHOD: `GET` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:17:25.170825 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf7299c-7f95-4e54-8cec-c59ddeb67cc6 service neutron] SCRIPT_NAME: `/identity` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:17:25.171133 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf7299c-7f95-4e54-8cec-c59ddeb67cc6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:17:25.181675 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cf7299c-7f95-4e54-8cec-c59ddeb67cc6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:17:25.183210 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cf7299c-7f95-4e54-8cec-c59ddeb67cc6 service neutron] RBAC: Authorization granted {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:17:25.194933 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: [pid: 88550|app: 0|req: 537/1060] 10.222.0.26 () {60 vars in 1365 bytes} [Wed Aug 17 19:17:25 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 19:17:27.850079 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b3ef126-10c4-4e95-af54-00e206e06acc None None] REQUEST_METHOD: `GET` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:17:27.850747 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b3ef126-10c4-4e95-af54-00e206e06acc None None] SCRIPT_NAME: `/identity` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:17:27.850747 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b3ef126-10c4-4e95-af54-00e206e06acc None None] PATH_INFO: `/` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:17:27.852056 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: [pid: 88551|app: 0|req: 524/1061] 127.0.0.1 () {54 vars in 917 bytes} [Wed Aug 17 19:17:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 17 19:17:27.858126 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea05ddb-0ed3-41ef-b865-117b606646a4 None None] REQUEST_METHOD: `POST` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:17:27.858724 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea05ddb-0ed3-41ef-b865-117b606646a4 None None] SCRIPT_NAME: `/identity` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:17:27.858877 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea05ddb-0ed3-41ef-b865-117b606646a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:17:27.878869 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.auth.core [None req-6ea05ddb-0ed3-41ef-b865-117b606646a4 None None] MFA Rules not processed for user `819d41a279e64291acc60de51e1530ae`. Rule list: `[]` (Enabled: `True`). {{(pid=88550) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 19:17:27.880108 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.common.fernet_utils [None req-6ea05ddb-0ed3-41ef-b865-117b606646a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:17:27.888196 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: [pid: 88550|app: 0|req: 538/1062] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Aug 17 19:17:27 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 19:17:28.230305 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b3ef126-10c4-4e95-af54-00e206e06acc None None] Authenticating user token {{(pid=88551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:17:28.241803 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b3ef126-10c4-4e95-af54-00e206e06acc None None] Validating token access rules against request {{(pid=88551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:17:28.245558 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61cc1baf-95c3-459c-b839-b91fa9f34b6f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8240f6e0b65545708f07e040c09e1490', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4bbf6c5abd684d899d09a08b0847d81c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:17:28.246158 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61cc1baf-95c3-459c-b839-b91fa9f34b6f service neutron] REQUEST_METHOD: `GET` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:17:28.246570 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61cc1baf-95c3-459c-b839-b91fa9f34b6f service neutron] SCRIPT_NAME: `/identity` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:17:28.246823 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61cc1baf-95c3-459c-b839-b91fa9f34b6f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:17:28.257212 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61cc1baf-95c3-459c-b839-b91fa9f34b6f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:17:28.258758 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61cc1baf-95c3-459c-b839-b91fa9f34b6f service neutron] RBAC: Authorization granted {{(pid=88551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:17:28.270040 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: [pid: 88551|app: 0|req: 525/1063] 10.222.0.26 () {60 vars in 1365 bytes} [Wed Aug 17 19:17:28 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 17 19:17:31.021323 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a143e3-f129-43d2-9b9a-28150e4131cb None None] REQUEST_METHOD: `GET` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:17:31.021903 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a143e3-f129-43d2-9b9a-28150e4131cb None None] SCRIPT_NAME: `/identity` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:17:31.022004 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a143e3-f129-43d2-9b9a-28150e4131cb None None] PATH_INFO: `/` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:17:31.023618 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: [pid: 88550|app: 0|req: 539/1064] 127.0.0.1 () {54 vars in 917 bytes} [Wed Aug 17 19:17:31 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 19:17:31.029700 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12631070-cd13-42e7-923d-ab0ba665d672 None None] REQUEST_METHOD: `POST` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:17:31.030257 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12631070-cd13-42e7-923d-ab0ba665d672 None None] SCRIPT_NAME: `/identity` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:17:31.030441 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12631070-cd13-42e7-923d-ab0ba665d672 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:17:31.051588 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.auth.core [None req-12631070-cd13-42e7-923d-ab0ba665d672 None None] MFA Rules not processed for user `819d41a279e64291acc60de51e1530ae`. Rule list: `[]` (Enabled: `True`). {{(pid=88551) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 19:17:31.052891 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.common.fernet_utils [None req-12631070-cd13-42e7-923d-ab0ba665d672 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:17:31.061146 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: [pid: 88551|app: 0|req: 526/1065] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Aug 17 19:17:31 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 17 19:17:31.417658 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02a143e3-f129-43d2-9b9a-28150e4131cb None None] Authenticating user token {{(pid=88550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:17:31.430351 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02a143e3-f129-43d2-9b9a-28150e4131cb None None] Validating token access rules against request {{(pid=88550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:17:31.434364 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38d20a86-757a-4fc3-b6ff-575a38db73e6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8240f6e0b65545708f07e040c09e1490', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4bbf6c5abd684d899d09a08b0847d81c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:17:31.435040 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d20a86-757a-4fc3-b6ff-575a38db73e6 service neutron] REQUEST_METHOD: `GET` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:17:31.435340 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d20a86-757a-4fc3-b6ff-575a38db73e6 service neutron] SCRIPT_NAME: `/identity` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:17:31.435615 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d20a86-757a-4fc3-b6ff-575a38db73e6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:17:31.446709 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38d20a86-757a-4fc3-b6ff-575a38db73e6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:17:31.448261 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38d20a86-757a-4fc3-b6ff-575a38db73e6 service neutron] RBAC: Authorization granted {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:17:31.459439 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: [pid: 88550|app: 0|req: 540/1066] 10.222.0.26 () {60 vars in 1365 bytes} [Wed Aug 17 19:17:31 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 19:17:33.872969 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e02a8a4e-3c76-4faa-a8b2-b3e11be3bcb8 None None] REQUEST_METHOD: `GET` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:17:33.873586 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e02a8a4e-3c76-4faa-a8b2-b3e11be3bcb8 None None] SCRIPT_NAME: `/identity` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:17:33.873586 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e02a8a4e-3c76-4faa-a8b2-b3e11be3bcb8 None None] PATH_INFO: `/` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:17:33.874906 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: [pid: 88551|app: 0|req: 527/1067] 127.0.0.1 () {54 vars in 917 bytes} [Wed Aug 17 19:17:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 17 19:17:33.880916 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d851b04a-6802-470d-b76e-108b8520d530 None None] REQUEST_METHOD: `POST` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:17:33.881470 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d851b04a-6802-470d-b76e-108b8520d530 None None] SCRIPT_NAME: `/identity` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:17:33.881565 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d851b04a-6802-470d-b76e-108b8520d530 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:17:33.901986 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.auth.core [None req-d851b04a-6802-470d-b76e-108b8520d530 None None] MFA Rules not processed for user `819d41a279e64291acc60de51e1530ae`. Rule list: `[]` (Enabled: `True`). {{(pid=88550) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 19:17:33.903323 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.common.fernet_utils [None req-d851b04a-6802-470d-b76e-108b8520d530 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:17:33.912063 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: [pid: 88550|app: 0|req: 541/1068] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Aug 17 19:17:33 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 19:17:34.264723 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e02a8a4e-3c76-4faa-a8b2-b3e11be3bcb8 None None] Authenticating user token {{(pid=88551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:17:34.277132 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e02a8a4e-3c76-4faa-a8b2-b3e11be3bcb8 None None] Validating token access rules against request {{(pid=88551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:17:34.281320 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ace1f59-1133-4ec6-854a-88d569d97c90 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8240f6e0b65545708f07e040c09e1490', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4bbf6c5abd684d899d09a08b0847d81c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:17:34.282080 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ace1f59-1133-4ec6-854a-88d569d97c90 service neutron] REQUEST_METHOD: `GET` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:17:34.282393 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ace1f59-1133-4ec6-854a-88d569d97c90 service neutron] SCRIPT_NAME: `/identity` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:17:34.282759 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ace1f59-1133-4ec6-854a-88d569d97c90 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:17:34.293540 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ace1f59-1133-4ec6-854a-88d569d97c90 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:17:34.295262 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ace1f59-1133-4ec6-854a-88d569d97c90 service neutron] RBAC: Authorization granted {{(pid=88551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:17:34.305762 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: [pid: 88551|app: 0|req: 528/1069] 10.222.0.26 () {60 vars in 1365 bytes} [Wed Aug 17 19:17:34 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 19:17:36.809247 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b423c0-1544-4d63-9d1e-b2f12703228c None None] REQUEST_METHOD: `GET` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:17:36.809860 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b423c0-1544-4d63-9d1e-b2f12703228c None None] SCRIPT_NAME: `/identity` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:17:36.809860 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b423c0-1544-4d63-9d1e-b2f12703228c None None] PATH_INFO: `/` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:17:36.811275 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: [pid: 88550|app: 0|req: 542/1070] 127.0.0.1 () {54 vars in 917 bytes} [Wed Aug 17 19:17:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 17 19:17:36.820314 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c0588fb-918f-4c54-bd0d-3c278f683b0d None None] REQUEST_METHOD: `POST` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:17:36.820884 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c0588fb-918f-4c54-bd0d-3c278f683b0d None None] SCRIPT_NAME: `/identity` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:17:36.821017 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c0588fb-918f-4c54-bd0d-3c278f683b0d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:17:36.829543 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG dbcounter [-] [88551] Writing DB stats keystone:SELECT=61 {{(pid=88551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:17:36.842352 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.auth.core [None req-4c0588fb-918f-4c54-bd0d-3c278f683b0d None None] MFA Rules not processed for user `819d41a279e64291acc60de51e1530ae`. Rule list: `[]` (Enabled: `True`). {{(pid=88551) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 19:17:36.843723 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.common.fernet_utils [None req-4c0588fb-918f-4c54-bd0d-3c278f683b0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:17:36.851994 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: [pid: 88551|app: 0|req: 529/1071] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Aug 17 19:17:36 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 19:17:37.199668 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3b423c0-1544-4d63-9d1e-b2f12703228c None None] Authenticating user token {{(pid=88550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:17:37.206653 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG dbcounter [-] [88550] Writing DB stats keystone:SELECT=69 {{(pid=88550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:17:37.214942 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3b423c0-1544-4d63-9d1e-b2f12703228c None None] Validating token access rules against request {{(pid=88550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:17:37.220984 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-462ef18a-e6fb-4123-b94b-b970e989bec5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8240f6e0b65545708f07e040c09e1490', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4bbf6c5abd684d899d09a08b0847d81c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:17:37.221950 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-462ef18a-e6fb-4123-b94b-b970e989bec5 service neutron] REQUEST_METHOD: `GET` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:17:37.222434 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-462ef18a-e6fb-4123-b94b-b970e989bec5 service neutron] SCRIPT_NAME: `/identity` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:17:37.222919 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-462ef18a-e6fb-4123-b94b-b970e989bec5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:17:37.238733 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-462ef18a-e6fb-4123-b94b-b970e989bec5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:17:37.240722 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-462ef18a-e6fb-4123-b94b-b970e989bec5 service neutron] RBAC: Authorization granted {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:17:37.258613 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: [pid: 88550|app: 0|req: 543/1072] 10.222.0.26 () {60 vars in 1365 bytes} [Wed Aug 17 19:17:37 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 59 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 19:17:39.674339 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d8c93d8-a71d-4bb1-aefe-b11f36e4a506 None None] REQUEST_METHOD: `GET` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:17:39.674999 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d8c93d8-a71d-4bb1-aefe-b11f36e4a506 None None] SCRIPT_NAME: `/identity` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:17:39.674999 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d8c93d8-a71d-4bb1-aefe-b11f36e4a506 None None] PATH_INFO: `/` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:17:39.676184 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: [pid: 88551|app: 0|req: 530/1073] 127.0.0.1 () {54 vars in 917 bytes} [Wed Aug 17 19:17:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 19:17:39.681981 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-867642eb-ffc9-40a4-b019-a8174bcc7a89 None None] REQUEST_METHOD: `POST` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:17:39.682530 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-867642eb-ffc9-40a4-b019-a8174bcc7a89 None None] SCRIPT_NAME: `/identity` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:17:39.682711 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-867642eb-ffc9-40a4-b019-a8174bcc7a89 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:17:39.704035 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.auth.core [None req-867642eb-ffc9-40a4-b019-a8174bcc7a89 None None] MFA Rules not processed for user `819d41a279e64291acc60de51e1530ae`. Rule list: `[]` (Enabled: `True`). {{(pid=88550) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 19:17:39.705692 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.common.fernet_utils [None req-867642eb-ffc9-40a4-b019-a8174bcc7a89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:17:39.714098 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: [pid: 88550|app: 0|req: 544/1074] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Aug 17 19:17:39 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 17 19:17:40.066081 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d8c93d8-a71d-4bb1-aefe-b11f36e4a506 None None] Authenticating user token {{(pid=88551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:17:40.077451 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d8c93d8-a71d-4bb1-aefe-b11f36e4a506 None None] Validating token access rules against request {{(pid=88551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:17:40.081150 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67a5d3ad-8212-4d94-bfd2-17f11424bf96 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8240f6e0b65545708f07e040c09e1490', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4bbf6c5abd684d899d09a08b0847d81c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:17:40.081799 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a5d3ad-8212-4d94-bfd2-17f11424bf96 service neutron] REQUEST_METHOD: `GET` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:17:40.082117 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a5d3ad-8212-4d94-bfd2-17f11424bf96 service neutron] SCRIPT_NAME: `/identity` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:17:40.082428 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a5d3ad-8212-4d94-bfd2-17f11424bf96 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:17:40.092603 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67a5d3ad-8212-4d94-bfd2-17f11424bf96 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:17:40.094119 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67a5d3ad-8212-4d94-bfd2-17f11424bf96 service neutron] RBAC: Authorization granted {{(pid=88551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:17:40.104822 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: [pid: 88551|app: 0|req: 531/1075] 10.222.0.26 () {60 vars in 1365 bytes} [Wed Aug 17 19:17:40 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 17 19:17:42.470072 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c15fdac4-78e8-423b-bf80-03ce8603fe99 None None] REQUEST_METHOD: `GET` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:17:42.470744 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c15fdac4-78e8-423b-bf80-03ce8603fe99 None None] SCRIPT_NAME: `/identity` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:17:42.470744 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c15fdac4-78e8-423b-bf80-03ce8603fe99 None None] PATH_INFO: `/` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:17:42.471995 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: [pid: 88550|app: 0|req: 545/1076] 127.0.0.1 () {54 vars in 917 bytes} [Wed Aug 17 19:17:42 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 17 19:17:42.480510 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e992336-fff0-408e-b295-293418d6ff17 None None] REQUEST_METHOD: `POST` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:17:42.481106 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e992336-fff0-408e-b295-293418d6ff17 None None] SCRIPT_NAME: `/identity` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:17:42.481106 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e992336-fff0-408e-b295-293418d6ff17 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:17:42.501556 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.auth.core [None req-5e992336-fff0-408e-b295-293418d6ff17 None None] MFA Rules not processed for user `819d41a279e64291acc60de51e1530ae`. Rule list: `[]` (Enabled: `True`). {{(pid=88551) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 19:17:42.502835 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.common.fernet_utils [None req-5e992336-fff0-408e-b295-293418d6ff17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:17:42.510884 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: [pid: 88551|app: 0|req: 532/1077] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Aug 17 19:17:42 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 19:17:42.854869 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c15fdac4-78e8-423b-bf80-03ce8603fe99 None None] Authenticating user token {{(pid=88550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:17:42.866387 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c15fdac4-78e8-423b-bf80-03ce8603fe99 None None] Validating token access rules against request {{(pid=88550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:17:42.870030 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2708b1f3-1775-4163-b57b-c5de43c5b72a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8240f6e0b65545708f07e040c09e1490', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4bbf6c5abd684d899d09a08b0847d81c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:17:42.870724 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2708b1f3-1775-4163-b57b-c5de43c5b72a service neutron] REQUEST_METHOD: `GET` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:17:42.871043 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2708b1f3-1775-4163-b57b-c5de43c5b72a service neutron] SCRIPT_NAME: `/identity` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:17:42.871354 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2708b1f3-1775-4163-b57b-c5de43c5b72a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:17:42.881565 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2708b1f3-1775-4163-b57b-c5de43c5b72a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:17:42.883194 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2708b1f3-1775-4163-b57b-c5de43c5b72a service neutron] RBAC: Authorization granted {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:17:42.893672 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: [pid: 88550|app: 0|req: 546/1078] 10.222.0.26 () {60 vars in 1365 bytes} [Wed Aug 17 19:17:42 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 19:17:45.292990 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-996b38b2-26a5-4e1b-a079-bbf630f3c6bd None None] REQUEST_METHOD: `GET` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:17:45.293855 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-996b38b2-26a5-4e1b-a079-bbf630f3c6bd None None] SCRIPT_NAME: `/identity` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:17:45.293855 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-996b38b2-26a5-4e1b-a079-bbf630f3c6bd None None] PATH_INFO: `/` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:17:45.295504 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: [pid: 88551|app: 0|req: 533/1079] 127.0.0.1 () {54 vars in 917 bytes} [Wed Aug 17 19:17:45 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 19:17:45.301727 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e64e95-a2cc-45df-8a3d-c3ae75360917 None None] REQUEST_METHOD: `POST` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:17:45.303915 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e64e95-a2cc-45df-8a3d-c3ae75360917 None None] SCRIPT_NAME: `/identity` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:17:45.303915 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e64e95-a2cc-45df-8a3d-c3ae75360917 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:17:45.324075 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.auth.core [None req-c4e64e95-a2cc-45df-8a3d-c3ae75360917 None None] MFA Rules not processed for user `819d41a279e64291acc60de51e1530ae`. Rule list: `[]` (Enabled: `True`). {{(pid=88550) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 19:17:45.325327 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.common.fernet_utils [None req-c4e64e95-a2cc-45df-8a3d-c3ae75360917 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:17:45.334238 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: [pid: 88550|app: 0|req: 547/1080] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Aug 17 19:17:45 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 19:17:45.676142 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-996b38b2-26a5-4e1b-a079-bbf630f3c6bd None None] Authenticating user token {{(pid=88551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:17:45.688337 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-996b38b2-26a5-4e1b-a079-bbf630f3c6bd None None] Validating token access rules against request {{(pid=88551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:17:45.692092 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-905acb8f-f94d-4ae7-999b-8053a785ad64 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8240f6e0b65545708f07e040c09e1490', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4bbf6c5abd684d899d09a08b0847d81c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:17:45.692709 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-905acb8f-f94d-4ae7-999b-8053a785ad64 service neutron] REQUEST_METHOD: `GET` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:17:45.692986 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-905acb8f-f94d-4ae7-999b-8053a785ad64 service neutron] SCRIPT_NAME: `/identity` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:17:45.693263 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-905acb8f-f94d-4ae7-999b-8053a785ad64 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:17:45.703977 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-905acb8f-f94d-4ae7-999b-8053a785ad64 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:17:45.705425 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-905acb8f-f94d-4ae7-999b-8053a785ad64 service neutron] RBAC: Authorization granted {{(pid=88551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:17:45.715923 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: [pid: 88551|app: 0|req: 534/1081] 10.222.0.26 () {60 vars in 1365 bytes} [Wed Aug 17 19:17:45 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 19:17:48.016423 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b45ed1-758a-42b6-8d29-88c2acab5e48 None None] REQUEST_METHOD: `GET` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:17:48.017030 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b45ed1-758a-42b6-8d29-88c2acab5e48 None None] SCRIPT_NAME: `/identity` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:17:48.017345 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b45ed1-758a-42b6-8d29-88c2acab5e48 None None] PATH_INFO: `/` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:17:48.019773 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: [pid: 88550|app: 0|req: 548/1082] 127.0.0.1 () {54 vars in 917 bytes} [Wed Aug 17 19:17:48 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 19:17:48.028095 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ddd0845-b0b0-4656-aeaa-81c0a4972a68 None None] REQUEST_METHOD: `POST` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:17:48.028803 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ddd0845-b0b0-4656-aeaa-81c0a4972a68 None None] SCRIPT_NAME: `/identity` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:17:48.028803 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ddd0845-b0b0-4656-aeaa-81c0a4972a68 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:17:48.050285 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.auth.core [None req-4ddd0845-b0b0-4656-aeaa-81c0a4972a68 None None] MFA Rules not processed for user `819d41a279e64291acc60de51e1530ae`. Rule list: `[]` (Enabled: `True`). {{(pid=88551) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 19:17:48.051595 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.common.fernet_utils [None req-4ddd0845-b0b0-4656-aeaa-81c0a4972a68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:17:48.060194 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: [pid: 88551|app: 0|req: 535/1083] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Aug 17 19:17:48 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 19:17:48.417374 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13b45ed1-758a-42b6-8d29-88c2acab5e48 None None] Authenticating user token {{(pid=88550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:17:48.428551 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13b45ed1-758a-42b6-8d29-88c2acab5e48 None None] Validating token access rules against request {{(pid=88550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:17:48.432193 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9402a40-0616-43e1-b4a7-30acacee6afc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8240f6e0b65545708f07e040c09e1490', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4bbf6c5abd684d899d09a08b0847d81c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:17:48.432817 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9402a40-0616-43e1-b4a7-30acacee6afc service neutron] REQUEST_METHOD: `GET` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:17:48.433098 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9402a40-0616-43e1-b4a7-30acacee6afc service neutron] SCRIPT_NAME: `/identity` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:17:48.433368 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9402a40-0616-43e1-b4a7-30acacee6afc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:17:48.443798 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9402a40-0616-43e1-b4a7-30acacee6afc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:17:48.445270 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9402a40-0616-43e1-b4a7-30acacee6afc service neutron] RBAC: Authorization granted {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:17:48.456475 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: [pid: 88550|app: 0|req: 549/1084] 10.222.0.26 () {60 vars in 1365 bytes} [Wed Aug 17 19:17:48 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 19:17:50.705097 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1322e829-1398-4d17-a93a-213de5076506 None None] REQUEST_METHOD: `GET` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:17:50.705648 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1322e829-1398-4d17-a93a-213de5076506 None None] SCRIPT_NAME: `/identity` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:17:50.705648 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1322e829-1398-4d17-a93a-213de5076506 None None] PATH_INFO: `/` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:17:50.706988 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: [pid: 88551|app: 0|req: 536/1085] 127.0.0.1 () {54 vars in 917 bytes} [Wed Aug 17 19:17:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 17 19:17:50.713039 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f823c1ba-0950-402e-89d8-26ad45fa1c40 None None] REQUEST_METHOD: `POST` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:17:50.713879 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f823c1ba-0950-402e-89d8-26ad45fa1c40 None None] SCRIPT_NAME: `/identity` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:17:50.714054 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f823c1ba-0950-402e-89d8-26ad45fa1c40 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:17:50.734802 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.auth.core [None req-f823c1ba-0950-402e-89d8-26ad45fa1c40 None None] MFA Rules not processed for user `819d41a279e64291acc60de51e1530ae`. Rule list: `[]` (Enabled: `True`). {{(pid=88550) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 19:17:50.736036 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.common.fernet_utils [None req-f823c1ba-0950-402e-89d8-26ad45fa1c40 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:17:50.744090 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: [pid: 88550|app: 0|req: 550/1086] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Aug 17 19:17:50 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 17 19:17:51.137187 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1322e829-1398-4d17-a93a-213de5076506 None None] Authenticating user token {{(pid=88551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:17:51.153679 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1322e829-1398-4d17-a93a-213de5076506 None None] Validating token access rules against request {{(pid=88551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:17:51.159191 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6f97f7b-ea4f-4011-881d-c9457ec2716e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8240f6e0b65545708f07e040c09e1490', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4bbf6c5abd684d899d09a08b0847d81c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:17:51.160048 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f97f7b-ea4f-4011-881d-c9457ec2716e service neutron] REQUEST_METHOD: `GET` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:17:51.160476 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f97f7b-ea4f-4011-881d-c9457ec2716e service neutron] SCRIPT_NAME: `/identity` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:17:51.160944 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f97f7b-ea4f-4011-881d-c9457ec2716e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:17:51.171412 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6f97f7b-ea4f-4011-881d-c9457ec2716e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:17:51.180688 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6f97f7b-ea4f-4011-881d-c9457ec2716e service neutron] RBAC: Authorization granted {{(pid=88551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:17:51.184372 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: [pid: 88551|app: 0|req: 537/1087] 10.222.0.26 () {60 vars in 1365 bytes} [Wed Aug 17 19:17:51 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 19:18:00.729139 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG dbcounter [-] [88550] Writing DB stats keystone:SELECT=26 {{(pid=88550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:18:01.179507 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG dbcounter [-] [88551] Writing DB stats keystone:SELECT=26 {{(pid=88551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:18:16.244037 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb12f8c-e218-42b8-8948-4706dbf6458e None None] REQUEST_METHOD: `GET` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:18:16.244715 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb12f8c-e218-42b8-8948-4706dbf6458e None None] SCRIPT_NAME: `/identity` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:18:16.244715 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb12f8c-e218-42b8-8948-4706dbf6458e None None] PATH_INFO: `/` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:18:16.245944 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: [pid: 88550|app: 0|req: 551/1088] 10.222.0.26 () {54 vars in 927 bytes} [Wed Aug 17 19:18:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 17 19:18:16.252814 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-409bea0e-d12a-4497-a2a7-c6eb1117e279 None None] REQUEST_METHOD: `POST` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:18:16.253457 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-409bea0e-d12a-4497-a2a7-c6eb1117e279 None None] SCRIPT_NAME: `/identity` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:18:16.253457 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-409bea0e-d12a-4497-a2a7-c6eb1117e279 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:18:16.273532 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.auth.core [None req-409bea0e-d12a-4497-a2a7-c6eb1117e279 None None] MFA Rules not processed for user `819d41a279e64291acc60de51e1530ae`. Rule list: `[]` (Enabled: `True`). {{(pid=88551) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 19:18:16.274907 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.common.fernet_utils [None req-409bea0e-d12a-4497-a2a7-c6eb1117e279 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:18:16.283762 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: [pid: 88551|app: 0|req: 538/1089] 10.222.0.26 () {58 vars in 1024 bytes} [Wed Aug 17 19:18:16 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 19:18:16.646127 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88179f15-0738-4959-95e3-e98b2b486f7f None None] REQUEST_METHOD: `GET` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:18:16.646414 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88179f15-0738-4959-95e3-e98b2b486f7f None None] SCRIPT_NAME: `/identity` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:18:16.646749 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88179f15-0738-4959-95e3-e98b2b486f7f None None] PATH_INFO: `/` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:18:16.648115 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: [pid: 88550|app: 0|req: 552/1090] 10.222.0.26 () {54 vars in 967 bytes} [Wed Aug 17 19:18:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 17 19:18:16.654612 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-637723b6-3caf-4780-9ed4-a3576e6a1a1e None None] REQUEST_METHOD: `POST` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:18:16.655023 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-637723b6-3caf-4780-9ed4-a3576e6a1a1e None None] SCRIPT_NAME: `/identity` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:18:16.655422 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-637723b6-3caf-4780-9ed4-a3576e6a1a1e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:18:16.675822 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.auth.core [None req-637723b6-3caf-4780-9ed4-a3576e6a1a1e None None] MFA Rules not processed for user `5f32f6111c1c4f1f86c2185bde99a368`. Rule list: `[]` (Enabled: `True`). {{(pid=88551) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 19:18:16.677233 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.common.fernet_utils [None req-637723b6-3caf-4780-9ed4-a3576e6a1a1e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:18:16.684040 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: [pid: 88551|app: 0|req: 539/1091] 10.222.0.26 () {58 vars in 1064 bytes} [Wed Aug 17 19:18:16 2022] POST /identity/v3/auth/tokens => generated 2680 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 19:18:16.692044 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88179f15-0738-4959-95e3-e98b2b486f7f None None] Authenticating user token {{(pid=88550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:18:16.704042 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88179f15-0738-4959-95e3-e98b2b486f7f None None] Validating token access rules against request {{(pid=88550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:18:16.708146 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21c66e8e-24fb-4fba-83c8-1bfc079c4a52 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f32f6111c1c4f1f86c2185bde99a368', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4bbf6c5abd684d899d09a08b0847d81c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:18:16.708817 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c66e8e-24fb-4fba-83c8-1bfc079c4a52 service glance] REQUEST_METHOD: `GET` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:18:16.709132 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c66e8e-24fb-4fba-83c8-1bfc079c4a52 service glance] SCRIPT_NAME: `/identity` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:18:16.709441 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c66e8e-24fb-4fba-83c8-1bfc079c4a52 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:18:16.720596 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21c66e8e-24fb-4fba-83c8-1bfc079c4a52 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:18:16.722105 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21c66e8e-24fb-4fba-83c8-1bfc079c4a52 service glance] RBAC: Authorization granted {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:18:16.732992 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: [pid: 88550|app: 0|req: 553/1092] 10.222.0.26 () {60 vars in 1365 bytes} [Wed Aug 17 19:18:16 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 19:18:19.147147 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dbd1a5e-981d-481a-b9dc-0e7136afa015 None None] REQUEST_METHOD: `GET` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:18:19.147795 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dbd1a5e-981d-481a-b9dc-0e7136afa015 None None] SCRIPT_NAME: `/identity` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:18:19.147795 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dbd1a5e-981d-481a-b9dc-0e7136afa015 None None] PATH_INFO: `/` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:18:19.149132 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: [pid: 88551|app: 0|req: 540/1093] 10.222.0.26 () {54 vars in 927 bytes} [Wed Aug 17 19:18:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 17 19:18:19.159057 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23991808-55cb-41df-b5e4-4e37e86800a7 None None] REQUEST_METHOD: `POST` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:18:19.159638 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23991808-55cb-41df-b5e4-4e37e86800a7 None None] SCRIPT_NAME: `/identity` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:18:19.160095 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23991808-55cb-41df-b5e4-4e37e86800a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:18:19.193334 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.auth.core [None req-23991808-55cb-41df-b5e4-4e37e86800a7 None None] MFA Rules not processed for user `819d41a279e64291acc60de51e1530ae`. Rule list: `[]` (Enabled: `True`). {{(pid=88550) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 19:18:19.195423 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.common.fernet_utils [None req-23991808-55cb-41df-b5e4-4e37e86800a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:18:19.210262 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: [pid: 88550|app: 0|req: 554/1094] 10.222.0.26 () {58 vars in 1024 bytes} [Wed Aug 17 19:18:19 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 53 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 19:18:19.552409 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dbd1a5e-981d-481a-b9dc-0e7136afa015 None None] Authenticating user token {{(pid=88551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:18:19.569187 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dbd1a5e-981d-481a-b9dc-0e7136afa015 None None] Validating token access rules against request {{(pid=88551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:18:19.573920 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-350516b8-69e8-4ffc-9567-9fc7400fdad9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '819d41a279e64291acc60de51e1530ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0490e0db9a14e81a7ea7b108a7ad6a0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:18:19.574580 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-350516b8-69e8-4ffc-9567-9fc7400fdad9 admin admin] REQUEST_METHOD: `GET` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:18:19.574873 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-350516b8-69e8-4ffc-9567-9fc7400fdad9 admin admin] SCRIPT_NAME: `/identity` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:18:19.575143 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-350516b8-69e8-4ffc-9567-9fc7400fdad9 admin admin] PATH_INFO: `/v3/projects` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:18:19.576688 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-350516b8-69e8-4ffc-9567-9fc7400fdad9 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:18:19.578839 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: WARNING py.warnings [None req-350516b8-69e8-4ffc-9567-9fc7400fdad9 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_projects": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 17 19:18:19.578839 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: warnings.warn(msg) Aug 17 19:18:19.578839 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: Aug 17 19:18:19.580188 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-350516b8-69e8-4ffc-9567-9fc7400fdad9 admin admin] RBAC: Authorization granted {{(pid=88551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:18:19.601579 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: [pid: 88551|app: 0|req: 541/1095] 10.222.0.26 () {56 vars in 1108 bytes} [Wed Aug 17 19:18:19 2022] GET /identity/v3/projects => generated 1606 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 17 19:18:22.013586 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed0be639-c266-42d8-b919-0d13f3d565ee None None] REQUEST_METHOD: `GET` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:18:22.014269 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed0be639-c266-42d8-b919-0d13f3d565ee None None] SCRIPT_NAME: `/identity` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:18:22.014269 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed0be639-c266-42d8-b919-0d13f3d565ee None None] PATH_INFO: `/` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:18:22.015711 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: [pid: 88550|app: 0|req: 555/1096] 10.222.0.26 () {54 vars in 927 bytes} [Wed Aug 17 19:18:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 17 19:18:22.021520 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9fa7791-7df1-40a8-a2c0-32cab32cae47 None None] REQUEST_METHOD: `POST` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:18:22.022076 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9fa7791-7df1-40a8-a2c0-32cab32cae47 None None] SCRIPT_NAME: `/identity` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:18:22.022076 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9fa7791-7df1-40a8-a2c0-32cab32cae47 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:18:22.042214 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.auth.core [None req-d9fa7791-7df1-40a8-a2c0-32cab32cae47 None None] MFA Rules not processed for user `819d41a279e64291acc60de51e1530ae`. Rule list: `[]` (Enabled: `True`). {{(pid=88551) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 19:18:22.043472 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.common.fernet_utils [None req-d9fa7791-7df1-40a8-a2c0-32cab32cae47 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:18:22.052479 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: [pid: 88551|app: 0|req: 542/1097] 10.222.0.26 () {58 vars in 1024 bytes} [Wed Aug 17 19:18:22 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 17 19:18:22.420753 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed0be639-c266-42d8-b919-0d13f3d565ee None None] Authenticating user token {{(pid=88550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:18:22.437527 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed0be639-c266-42d8-b919-0d13f3d565ee None None] Validating token access rules against request {{(pid=88550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:18:22.446267 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b291ff00-6189-4160-bb3e-1ee9bec7b0ae service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ae23e7a10d54989a25c9f3019184d01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4bbf6c5abd684d899d09a08b0847d81c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:18:22.447359 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b291ff00-6189-4160-bb3e-1ee9bec7b0ae service nova] REQUEST_METHOD: `GET` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:18:22.447859 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b291ff00-6189-4160-bb3e-1ee9bec7b0ae service nova] SCRIPT_NAME: `/identity` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:18:22.448361 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b291ff00-6189-4160-bb3e-1ee9bec7b0ae service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:18:22.464150 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b291ff00-6189-4160-bb3e-1ee9bec7b0ae service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:18:22.467646 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b291ff00-6189-4160-bb3e-1ee9bec7b0ae service nova] RBAC: Authorization granted {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:18:22.486333 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: [pid: 88550|app: 0|req: 556/1098] 10.222.0.26 () {60 vars in 1365 bytes} [Wed Aug 17 19:18:22 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 67 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 19:18:24.991279 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-803e12df-deab-44e1-9503-1b3385669580 None None] REQUEST_METHOD: `GET` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:18:24.991884 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-803e12df-deab-44e1-9503-1b3385669580 None None] SCRIPT_NAME: `/identity` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:18:24.991884 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-803e12df-deab-44e1-9503-1b3385669580 None None] PATH_INFO: `/` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:18:24.993173 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: [pid: 88551|app: 0|req: 543/1099] 10.222.0.26 () {54 vars in 927 bytes} [Wed Aug 17 19:18:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 19:18:24.999049 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d5bcd3-a2d5-4feb-80af-7da2e4e2507d None None] REQUEST_METHOD: `POST` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:18:24.999600 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d5bcd3-a2d5-4feb-80af-7da2e4e2507d None None] SCRIPT_NAME: `/identity` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:18:24.999600 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d5bcd3-a2d5-4feb-80af-7da2e4e2507d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:18:25.021321 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.auth.core [None req-e8d5bcd3-a2d5-4feb-80af-7da2e4e2507d None None] MFA Rules not processed for user `819d41a279e64291acc60de51e1530ae`. Rule list: `[]` (Enabled: `True`). {{(pid=88550) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 19:18:25.022566 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.common.fernet_utils [None req-e8d5bcd3-a2d5-4feb-80af-7da2e4e2507d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:18:25.031322 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: [pid: 88550|app: 0|req: 557/1100] 10.222.0.26 () {58 vars in 1024 bytes} [Wed Aug 17 19:18:24 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 19:18:25.422024 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-803e12df-deab-44e1-9503-1b3385669580 None None] Authenticating user token {{(pid=88551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:18:25.433236 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-803e12df-deab-44e1-9503-1b3385669580 None None] Validating token access rules against request {{(pid=88551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:18:25.437542 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e81445eb-a6af-4785-bebd-4c6c44a41f22 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8240f6e0b65545708f07e040c09e1490', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4bbf6c5abd684d899d09a08b0847d81c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:18:25.438144 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e81445eb-a6af-4785-bebd-4c6c44a41f22 service neutron] REQUEST_METHOD: `GET` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:18:25.438422 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e81445eb-a6af-4785-bebd-4c6c44a41f22 service neutron] SCRIPT_NAME: `/identity` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:18:25.438720 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e81445eb-a6af-4785-bebd-4c6c44a41f22 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:18:25.448534 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e81445eb-a6af-4785-bebd-4c6c44a41f22 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:18:25.450113 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e81445eb-a6af-4785-bebd-4c6c44a41f22 service neutron] RBAC: Authorization granted {{(pid=88551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:18:25.460959 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: [pid: 88551|app: 0|req: 544/1101] 10.222.0.26 () {60 vars in 1365 bytes} [Wed Aug 17 19:18:25 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 19:18:27.789681 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa10187-f1e4-4258-86af-80d56433e2d3 None None] REQUEST_METHOD: `GET` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:18:27.790586 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa10187-f1e4-4258-86af-80d56433e2d3 None None] SCRIPT_NAME: `/identity` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:18:27.790586 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa10187-f1e4-4258-86af-80d56433e2d3 None None] PATH_INFO: `/` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:18:27.791593 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: [pid: 88550|app: 0|req: 558/1102] 10.222.0.26 () {54 vars in 927 bytes} [Wed Aug 17 19:18:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 17 19:18:27.798068 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-917a5940-9d91-49f8-90c6-dfee2c4fdcf6 None None] REQUEST_METHOD: `POST` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:18:27.798645 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-917a5940-9d91-49f8-90c6-dfee2c4fdcf6 None None] SCRIPT_NAME: `/identity` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:18:27.798645 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-917a5940-9d91-49f8-90c6-dfee2c4fdcf6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:18:27.820237 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.auth.core [None req-917a5940-9d91-49f8-90c6-dfee2c4fdcf6 None None] MFA Rules not processed for user `819d41a279e64291acc60de51e1530ae`. Rule list: `[]` (Enabled: `True`). {{(pid=88551) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 19:18:27.821460 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.common.fernet_utils [None req-917a5940-9d91-49f8-90c6-dfee2c4fdcf6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:18:27.829424 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: [pid: 88551|app: 0|req: 545/1103] 10.222.0.26 () {58 vars in 1024 bytes} [Wed Aug 17 19:18:27 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 17 19:18:28.178247 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aa10187-f1e4-4258-86af-80d56433e2d3 None None] Authenticating user token {{(pid=88550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:18:28.195055 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aa10187-f1e4-4258-86af-80d56433e2d3 None None] Validating token access rules against request {{(pid=88550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:18:28.198829 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b168be22-ddc8-4314-8e88-dce76f295feb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8240f6e0b65545708f07e040c09e1490', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4bbf6c5abd684d899d09a08b0847d81c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:18:28.199432 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b168be22-ddc8-4314-8e88-dce76f295feb service neutron] REQUEST_METHOD: `GET` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:18:28.199711 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b168be22-ddc8-4314-8e88-dce76f295feb service neutron] SCRIPT_NAME: `/identity` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:18:28.199983 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b168be22-ddc8-4314-8e88-dce76f295feb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:18:28.209735 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b168be22-ddc8-4314-8e88-dce76f295feb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:18:28.211218 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b168be22-ddc8-4314-8e88-dce76f295feb service neutron] RBAC: Authorization granted {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:18:28.223323 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: [pid: 88550|app: 0|req: 559/1104] 10.222.0.26 () {60 vars in 1365 bytes} [Wed Aug 17 19:18:28 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 19:18:30.603618 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e44ec8db-fae8-491b-8213-34a6bc4c1f33 None None] REQUEST_METHOD: `GET` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:18:30.604279 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e44ec8db-fae8-491b-8213-34a6bc4c1f33 None None] SCRIPT_NAME: `/identity` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:18:30.604279 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e44ec8db-fae8-491b-8213-34a6bc4c1f33 None None] PATH_INFO: `/` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:18:30.605508 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: [pid: 88551|app: 0|req: 546/1105] 10.222.0.26 () {54 vars in 927 bytes} [Wed Aug 17 19:18:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 17 19:18:30.612202 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea50e6fa-b6b1-4ef7-8931-48ae4af62c4f None None] REQUEST_METHOD: `POST` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:18:30.612879 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea50e6fa-b6b1-4ef7-8931-48ae4af62c4f None None] SCRIPT_NAME: `/identity` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:18:30.612879 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea50e6fa-b6b1-4ef7-8931-48ae4af62c4f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:18:30.632673 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.auth.core [None req-ea50e6fa-b6b1-4ef7-8931-48ae4af62c4f None None] MFA Rules not processed for user `819d41a279e64291acc60de51e1530ae`. Rule list: `[]` (Enabled: `True`). {{(pid=88550) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 19:18:30.633904 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.common.fernet_utils [None req-ea50e6fa-b6b1-4ef7-8931-48ae4af62c4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:18:30.641867 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: [pid: 88550|app: 0|req: 560/1106] 10.222.0.26 () {58 vars in 1024 bytes} [Wed Aug 17 19:18:30 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 19:18:30.992619 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e44ec8db-fae8-491b-8213-34a6bc4c1f33 None None] Authenticating user token {{(pid=88551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:18:31.005113 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e44ec8db-fae8-491b-8213-34a6bc4c1f33 None None] Validating token access rules against request {{(pid=88551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:18:31.010527 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c39af46c-014b-48fd-8174-dc7140b95ec6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8240f6e0b65545708f07e040c09e1490', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4bbf6c5abd684d899d09a08b0847d81c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:18:31.011564 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39af46c-014b-48fd-8174-dc7140b95ec6 service neutron] REQUEST_METHOD: `GET` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:18:31.012070 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39af46c-014b-48fd-8174-dc7140b95ec6 service neutron] SCRIPT_NAME: `/identity` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:18:31.013054 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39af46c-014b-48fd-8174-dc7140b95ec6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:18:31.030192 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c39af46c-014b-48fd-8174-dc7140b95ec6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:18:31.033006 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c39af46c-014b-48fd-8174-dc7140b95ec6 service neutron] RBAC: Authorization granted {{(pid=88551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:18:31.050483 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: [pid: 88551|app: 0|req: 547/1107] 10.222.0.26 () {60 vars in 1365 bytes} [Wed Aug 17 19:18:30 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 58 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 19:18:33.823672 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e89df9a1-1961-41a9-a37d-2da5633b5ae0 None None] REQUEST_METHOD: `GET` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:18:33.824247 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e89df9a1-1961-41a9-a37d-2da5633b5ae0 None None] SCRIPT_NAME: `/identity` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:18:33.824247 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e89df9a1-1961-41a9-a37d-2da5633b5ae0 None None] PATH_INFO: `/` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:18:33.825743 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: [pid: 88550|app: 0|req: 561/1108] 10.222.0.26 () {54 vars in 927 bytes} [Wed Aug 17 19:18:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 19:18:33.831418 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce8c417-0c16-4a02-bf7d-da249674c1e4 None None] REQUEST_METHOD: `POST` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:18:33.831960 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce8c417-0c16-4a02-bf7d-da249674c1e4 None None] SCRIPT_NAME: `/identity` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:18:33.832133 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce8c417-0c16-4a02-bf7d-da249674c1e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:18:33.852746 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.auth.core [None req-4ce8c417-0c16-4a02-bf7d-da249674c1e4 None None] MFA Rules not processed for user `819d41a279e64291acc60de51e1530ae`. Rule list: `[]` (Enabled: `True`). {{(pid=88551) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 19:18:33.854027 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.common.fernet_utils [None req-4ce8c417-0c16-4a02-bf7d-da249674c1e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:18:33.863643 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: [pid: 88551|app: 0|req: 548/1109] 10.222.0.26 () {58 vars in 1024 bytes} [Wed Aug 17 19:18:33 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 19:18:34.219252 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e89df9a1-1961-41a9-a37d-2da5633b5ae0 None None] Authenticating user token {{(pid=88550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:18:34.231001 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e89df9a1-1961-41a9-a37d-2da5633b5ae0 None None] Validating token access rules against request {{(pid=88550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:18:34.234806 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cabd2200-0cdd-4699-9a3b-4da2e6b9eca5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8240f6e0b65545708f07e040c09e1490', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4bbf6c5abd684d899d09a08b0847d81c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:18:34.235425 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cabd2200-0cdd-4699-9a3b-4da2e6b9eca5 service neutron] REQUEST_METHOD: `GET` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:18:34.235699 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cabd2200-0cdd-4699-9a3b-4da2e6b9eca5 service neutron] SCRIPT_NAME: `/identity` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:18:34.235966 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cabd2200-0cdd-4699-9a3b-4da2e6b9eca5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:18:34.245796 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cabd2200-0cdd-4699-9a3b-4da2e6b9eca5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:18:34.247821 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cabd2200-0cdd-4699-9a3b-4da2e6b9eca5 service neutron] RBAC: Authorization granted {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:18:34.258573 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: [pid: 88550|app: 0|req: 562/1110] 10.222.0.26 () {60 vars in 1365 bytes} [Wed Aug 17 19:18:34 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 19:18:43.847633 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG dbcounter [-] [88551] Writing DB stats keystone:SELECT=33 {{(pid=88551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:18:44.253998 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG dbcounter [-] [88550] Writing DB stats keystone:SELECT=33 {{(pid=88550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:20:00.528510 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef446de-cf6b-44dc-86e2-2b82e4338f9a None None] REQUEST_METHOD: `POST` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:20:00.529150 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef446de-cf6b-44dc-86e2-2b82e4338f9a None None] SCRIPT_NAME: `/identity` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:20:00.529150 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef446de-cf6b-44dc-86e2-2b82e4338f9a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:20:00.548978 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.auth.core [None req-0ef446de-cf6b-44dc-86e2-2b82e4338f9a None None] MFA Rules not processed for user `819d41a279e64291acc60de51e1530ae`. Rule list: `[]` (Enabled: `True`). {{(pid=88551) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 19:20:00.550210 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.common.fernet_utils [None req-0ef446de-cf6b-44dc-86e2-2b82e4338f9a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:20:00.558689 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: [pid: 88551|app: 0|req: 549/1111] 10.222.0.26 () {58 vars in 958 bytes} [Wed Aug 17 19:20:00 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 19:20:00.567256 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1264091d-f5d7-46fc-94c1-8853df74def6 None None] REQUEST_METHOD: `POST` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:20:00.567854 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1264091d-f5d7-46fc-94c1-8853df74def6 None None] SCRIPT_NAME: `/identity` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:20:00.567854 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1264091d-f5d7-46fc-94c1-8853df74def6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:20:00.589947 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.auth.core [None req-1264091d-f5d7-46fc-94c1-8853df74def6 None None] MFA Rules not processed for user `819d41a279e64291acc60de51e1530ae`. Rule list: `[]` (Enabled: `True`). {{(pid=88550) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 19:20:00.591205 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.common.fernet_utils [None req-1264091d-f5d7-46fc-94c1-8853df74def6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:20:00.598947 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: [pid: 88550|app: 0|req: 563/1112] 10.222.0.26 () {58 vars in 958 bytes} [Wed Aug 17 19:20:00 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 19:20:00.603882 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ef446de-cf6b-44dc-86e2-2b82e4338f9a None None] Authenticating user token {{(pid=88551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:20:00.613895 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ef446de-cf6b-44dc-86e2-2b82e4338f9a None None] Validating token access rules against request {{(pid=88551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:20:00.621048 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee005c5c-df66-41c9-bd81-36a0a2c93ced admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '819d41a279e64291acc60de51e1530ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0490e0db9a14e81a7ea7b108a7ad6a0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:20:00.621048 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee005c5c-df66-41c9-bd81-36a0a2c93ced admin admin] REQUEST_METHOD: `GET` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:20:00.621048 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee005c5c-df66-41c9-bd81-36a0a2c93ced admin admin] SCRIPT_NAME: `/identity` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:20:00.621048 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee005c5c-df66-41c9-bd81-36a0a2c93ced admin admin] PATH_INFO: `/v3/domains` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:20:00.621442 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee005c5c-df66-41c9-bd81-36a0a2c93ced admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88551) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 19:20:00.621442 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee005c5c-df66-41c9-bd81-36a0a2c93ced admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:20:00.622247 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: WARNING py.warnings [None req-ee005c5c-df66-41c9-bd81-36a0a2c93ced admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 17 19:20:00.622247 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: warnings.warn(msg) Aug 17 19:20:00.622247 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: Aug 17 19:20:00.623344 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee005c5c-df66-41c9-bd81-36a0a2c93ced admin admin] RBAC: Authorization granted {{(pid=88551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:20:00.636673 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: [pid: 88551|app: 0|req: 550/1113] 10.222.0.26 () {58 vars in 1153 bytes} [Wed Aug 17 19:20:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 19:20:00.645592 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1264091d-f5d7-46fc-94c1-8853df74def6 None None] Authenticating user token {{(pid=88550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:20:00.655047 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1264091d-f5d7-46fc-94c1-8853df74def6 None None] Validating token access rules against request {{(pid=88550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:20:00.659632 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d827b50-3db9-4af0-8539-679110a9ce66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '819d41a279e64291acc60de51e1530ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0490e0db9a14e81a7ea7b108a7ad6a0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:20:00.660222 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d827b50-3db9-4af0-8539-679110a9ce66 admin admin] REQUEST_METHOD: `POST` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:20:00.660498 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d827b50-3db9-4af0-8539-679110a9ce66 admin admin] SCRIPT_NAME: `/identity` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:20:00.660766 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d827b50-3db9-4af0-8539-679110a9ce66 admin admin] PATH_INFO: `/v3/projects` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:20:00.661397 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d827b50-3db9-4af0-8539-679110a9ce66 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:20:00.663223 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: WARNING py.warnings [None req-5d827b50-3db9-4af0-8539-679110a9ce66 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 17 19:20:00.663223 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: warnings.warn(msg) Aug 17 19:20:00.663223 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: Aug 17 19:20:00.664408 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d827b50-3db9-4af0-8539-679110a9ce66 admin admin] RBAC: Authorization granted {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:20:00.767239 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: [pid: 88550|app: 0|req: 564/1114] 10.222.0.26 () {60 vars in 1153 bytes} [Wed Aug 17 19:20:00 2022] POST /identity/v3/projects => generated 379 bytes in 122 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 17 19:20:00.771500 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee005c5c-df66-41c9-bd81-36a0a2c93ced admin admin] Authenticating user token {{(pid=88551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:20:00.781895 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee005c5c-df66-41c9-bd81-36a0a2c93ced admin admin] Validating token access rules against request {{(pid=88551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:20:00.842488 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4a50e21-792e-4935-b61d-9930bdbf9bb0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '819d41a279e64291acc60de51e1530ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0490e0db9a14e81a7ea7b108a7ad6a0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:20:00.843255 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a50e21-792e-4935-b61d-9930bdbf9bb0 admin admin] REQUEST_METHOD: `POST` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:20:00.843535 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a50e21-792e-4935-b61d-9930bdbf9bb0 admin admin] SCRIPT_NAME: `/identity` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:20:00.843805 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a50e21-792e-4935-b61d-9930bdbf9bb0 admin admin] PATH_INFO: `/v3/users` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:20:00.844459 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4a50e21-792e-4935-b61d-9930bdbf9bb0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:20:00.845583 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: WARNING py.warnings [None req-f4a50e21-792e-4935-b61d-9930bdbf9bb0 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 17 19:20:00.845583 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: warnings.warn(msg) Aug 17 19:20:00.845583 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: Aug 17 19:20:00.846982 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4a50e21-792e-4935-b61d-9930bdbf9bb0 admin admin] RBAC: Authorization granted {{(pid=88551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:20:00.957581 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: [pid: 88551|app: 0|req: 551/1115] 10.222.0.26 () {60 vars in 1144 bytes} [Wed Aug 17 19:20:00 2022] POST /identity/v3/users => generated 290 bytes in 187 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 19:20:00.961973 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d827b50-3db9-4af0-8539-679110a9ce66 admin admin] Authenticating user token {{(pid=88550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:20:00.973134 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d827b50-3db9-4af0-8539-679110a9ce66 admin admin] Validating token access rules against request {{(pid=88550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:20:00.978291 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62099c0f-ed48-467f-9dff-50bc7d1d67e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '819d41a279e64291acc60de51e1530ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0490e0db9a14e81a7ea7b108a7ad6a0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:20:00.978931 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62099c0f-ed48-467f-9dff-50bc7d1d67e5 admin admin] REQUEST_METHOD: `GET` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:20:00.979203 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62099c0f-ed48-467f-9dff-50bc7d1d67e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:20:00.979470 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62099c0f-ed48-467f-9dff-50bc7d1d67e5 admin admin] PATH_INFO: `/v3/roles` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:20:00.980114 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62099c0f-ed48-467f-9dff-50bc7d1d67e5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:20:00.981114 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: WARNING py.warnings [None req-62099c0f-ed48-467f-9dff-50bc7d1d67e5 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 17 19:20:00.981114 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: warnings.warn(msg) Aug 17 19:20:00.981114 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: Aug 17 19:20:00.981999 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62099c0f-ed48-467f-9dff-50bc7d1d67e5 admin admin] RBAC: Authorization granted {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:20:00.995552 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: [pid: 88550|app: 0|req: 565/1116] 10.222.0.26 () {58 vars in 1122 bytes} [Wed Aug 17 19:20:00 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 19:20:00.999762 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4a50e21-792e-4935-b61d-9930bdbf9bb0 admin admin] Authenticating user token {{(pid=88551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:20:01.010011 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4a50e21-792e-4935-b61d-9930bdbf9bb0 admin admin] Validating token access rules against request {{(pid=88551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:20:01.014732 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3480c05c-3f9f-430e-a6ff-cfcef2d9c9de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '819d41a279e64291acc60de51e1530ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0490e0db9a14e81a7ea7b108a7ad6a0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:20:01.015391 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3480c05c-3f9f-430e-a6ff-cfcef2d9c9de admin admin] REQUEST_METHOD: `GET` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:20:01.015678 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3480c05c-3f9f-430e-a6ff-cfcef2d9c9de admin admin] SCRIPT_NAME: `/identity` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:20:01.015956 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3480c05c-3f9f-430e-a6ff-cfcef2d9c9de admin admin] PATH_INFO: `/v3/roles` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:20:01.016623 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3480c05c-3f9f-430e-a6ff-cfcef2d9c9de admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:20:01.017636 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: WARNING py.warnings [None req-3480c05c-3f9f-430e-a6ff-cfcef2d9c9de admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 17 19:20:01.017636 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: warnings.warn(msg) Aug 17 19:20:01.017636 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: Aug 17 19:20:01.018580 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3480c05c-3f9f-430e-a6ff-cfcef2d9c9de admin admin] RBAC: Authorization granted {{(pid=88551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:20:01.032301 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: [pid: 88551|app: 0|req: 552/1117] 10.222.0.26 () {58 vars in 1122 bytes} [Wed Aug 17 19:20:00 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 19:20:01.036514 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62099c0f-ed48-467f-9dff-50bc7d1d67e5 admin admin] Authenticating user token {{(pid=88550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:20:01.047011 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62099c0f-ed48-467f-9dff-50bc7d1d67e5 admin admin] Validating token access rules against request {{(pid=88550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:20:01.057626 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd19ee39-819d-476b-832a-e100bdb580d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '819d41a279e64291acc60de51e1530ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0490e0db9a14e81a7ea7b108a7ad6a0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:20:01.058265 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd19ee39-819d-476b-832a-e100bdb580d8 admin admin] REQUEST_METHOD: `PUT` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:20:01.058568 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd19ee39-819d-476b-832a-e100bdb580d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:20:01.058840 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd19ee39-819d-476b-832a-e100bdb580d8 admin admin] PATH_INFO: `/v3/projects/fc9e630381a643d499750a759eee9312/users/08273d102b4c42079909264e3811da87/roles/748773430faa4030989e1e77b3f361e1` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:20:01.073731 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd19ee39-819d-476b-832a-e100bdb580d8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fc9e630381a643d499750a759eee9312, user_id=08273d102b4c42079909264e3811da87, role_id=748773430faa4030989e1e77b3f361e1)` {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:20:01.074802 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: WARNING py.warnings [None req-dd19ee39-819d-476b-832a-e100bdb580d8 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 17 19:20:01.074802 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: warnings.warn(msg) Aug 17 19:20:01.074802 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: Aug 17 19:20:01.076713 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd19ee39-819d-476b-832a-e100bdb580d8 admin admin] RBAC: Authorization granted {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:20:01.187217 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: [pid: 88550|app: 0|req: 566/1118] 10.222.0.26 () {60 vars in 1483 bytes} [Wed Aug 17 19:20:01 2022] PUT /identity/v3/projects/fc9e630381a643d499750a759eee9312/users/08273d102b4c42079909264e3811da87/roles/748773430faa4030989e1e77b3f361e1 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 19:20:01.199769 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a8f61dc-2590-40e8-ae86-a449da16e882 None None] REQUEST_METHOD: `POST` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:20:01.210745 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a8f61dc-2590-40e8-ae86-a449da16e882 None None] SCRIPT_NAME: `/identity` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:20:01.210745 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a8f61dc-2590-40e8-ae86-a449da16e882 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:20:01.229546 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.auth.core [None req-8a8f61dc-2590-40e8-ae86-a449da16e882 None None] MFA Rules not processed for user `08273d102b4c42079909264e3811da87`. Rule list: `[]` (Enabled: `True`). {{(pid=88551) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 19:20:01.230818 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.common.fernet_utils [None req-8a8f61dc-2590-40e8-ae86-a449da16e882 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:20:01.301368 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: [pid: 88551|app: 0|req: 553/1119] 10.222.0.26 () {58 vars in 958 bytes} [Wed Aug 17 19:20:01 2022] POST /identity/v3/auth/tokens => generated 2816 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 19:20:01.315899 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef4d07bc-bc2b-49a6-a37f-c9cccf4dbc3f None None] REQUEST_METHOD: `GET` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:20:01.316185 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef4d07bc-bc2b-49a6-a37f-c9cccf4dbc3f None None] SCRIPT_NAME: `/identity` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:20:01.316461 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef4d07bc-bc2b-49a6-a37f-c9cccf4dbc3f None None] PATH_INFO: `/` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:20:01.317919 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: [pid: 88550|app: 0|req: 567/1120] 10.222.0.26 () {54 vars in 964 bytes} [Wed Aug 17 19:20:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 19:20:01.323486 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-509bb04a-e4e1-4aae-94ee-31e417e62479 None None] REQUEST_METHOD: `POST` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:20:01.323771 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-509bb04a-e4e1-4aae-94ee-31e417e62479 None None] SCRIPT_NAME: `/identity` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:20:01.324047 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-509bb04a-e4e1-4aae-94ee-31e417e62479 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:20:01.359580 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.auth.core [None req-509bb04a-e4e1-4aae-94ee-31e417e62479 None None] MFA Rules not processed for user `0a7ec0aa480147f897f8a76b5b29f3c4`. Rule list: `[]` (Enabled: `True`). {{(pid=88551) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 19:20:01.360831 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.common.fernet_utils [None req-509bb04a-e4e1-4aae-94ee-31e417e62479 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:20:01.397573 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG dbcounter [-] [88551] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:20:01.419147 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: [pid: 88551|app: 0|req: 554/1121] 10.222.0.26 () {58 vars in 1061 bytes} [Wed Aug 17 19:20:01 2022] POST /identity/v3/auth/tokens => generated 2680 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 19:20:01.427200 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef4d07bc-bc2b-49a6-a37f-c9cccf4dbc3f None None] Authenticating user token {{(pid=88550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:20:01.438882 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef4d07bc-bc2b-49a6-a37f-c9cccf4dbc3f None None] Validating token access rules against request {{(pid=88550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:20:01.442666 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58161f62-d504-44c5-94dd-86489603c075 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a7ec0aa480147f897f8a76b5b29f3c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4bbf6c5abd684d899d09a08b0847d81c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:20:01.446007 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58161f62-d504-44c5-94dd-86489603c075 service cinder] REQUEST_METHOD: `GET` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:20:01.446007 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58161f62-d504-44c5-94dd-86489603c075 service cinder] SCRIPT_NAME: `/identity` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:20:01.446007 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58161f62-d504-44c5-94dd-86489603c075 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:20:01.453342 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58161f62-d504-44c5-94dd-86489603c075 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:20:01.454861 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58161f62-d504-44c5-94dd-86489603c075 service cinder] RBAC: Authorization granted {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:20:01.465431 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: [pid: 88550|app: 0|req: 568/1122] 10.222.0.26 () {60 vars in 1365 bytes} [Wed Aug 17 19:20:01 2022] GET /identity/v3/auth/tokens => generated 2816 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 19:20:01.505454 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f399f745-9d3f-4fdd-b94d-5394d6ef9301 None None] REQUEST_METHOD: `GET` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:20:01.505731 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f399f745-9d3f-4fdd-b94d-5394d6ef9301 None None] SCRIPT_NAME: `/identity` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:20:01.506025 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f399f745-9d3f-4fdd-b94d-5394d6ef9301 None None] PATH_INFO: `/` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:20:01.507387 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: [pid: 88551|app: 0|req: 555/1123] 10.222.0.26 () {52 vars in 830 bytes} [Wed Aug 17 19:20:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 19:20:01.511308 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58161f62-d504-44c5-94dd-86489603c075 service cinder] Authenticating user token {{(pid=88550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:20:01.577105 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58161f62-d504-44c5-94dd-86489603c075 service cinder] Validating token access rules against request {{(pid=88550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:20:01.581566 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dc389a8-7c62-4d00-8f72-b6344bf31372 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '819d41a279e64291acc60de51e1530ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0490e0db9a14e81a7ea7b108a7ad6a0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:20:01.582185 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc389a8-7c62-4d00-8f72-b6344bf31372 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:20:01.582450 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc389a8-7c62-4d00-8f72-b6344bf31372 admin admin] SCRIPT_NAME: `/identity` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:20:01.582747 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc389a8-7c62-4d00-8f72-b6344bf31372 admin admin] PATH_INFO: `/v3/users/08273d102b4c42079909264e3811da87` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:20:01.583866 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dc389a8-7c62-4d00-8f72-b6344bf31372 admin admin] RBAC: Authorizing `identity:delete_user(user_id=08273d102b4c42079909264e3811da87)` {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:20:01.584882 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: WARNING py.warnings [None req-8dc389a8-7c62-4d00-8f72-b6344bf31372 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 17 19:20:01.584882 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: warnings.warn(msg) Aug 17 19:20:01.584882 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: Aug 17 19:20:01.587042 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dc389a8-7c62-4d00-8f72-b6344bf31372 admin admin] RBAC: Authorization granted {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:20:01.881307 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.notifications [None req-8dc389a8-7c62-4d00-8f72-b6344bf31372 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '08273d102b4c42079909264e3811da87'} {{(pid=88550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 19:20:01.985638 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.notifications [None req-8dc389a8-7c62-4d00-8f72-b6344bf31372 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '08273d102b4c42079909264e3811da87'} {{(pid=88550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 19:20:01.986267 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.notifications [None req-8dc389a8-7c62-4d00-8f72-b6344bf31372 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '08273d102b4c42079909264e3811da87'} {{(pid=88550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 19:20:02.001642 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.notifications [None req-8dc389a8-7c62-4d00-8f72-b6344bf31372 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '08273d102b4c42079909264e3811da87'} {{(pid=88550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 19:20:02.002424 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.notifications [None req-8dc389a8-7c62-4d00-8f72-b6344bf31372 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '08273d102b4c42079909264e3811da87'} {{(pid=88550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 19:20:02.024393 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG dbcounter [-] [88550] Writing DB stats keystone:SELECT=88,keystone:INSERT=3,keystone:DELETE=9 {{(pid=88550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:20:02.032590 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: [pid: 88550|app: 0|req: 569/1124] 10.222.0.26 () {58 vars in 1224 bytes} [Wed Aug 17 19:20:01 2022] DELETE /identity/v3/users/08273d102b4c42079909264e3811da87 => generated 0 bytes in 522 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 19:20:02.041403 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b8dfcd-1076-4c63-a2eb-348097b491d4 None None] REQUEST_METHOD: `POST` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:20:02.041886 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b8dfcd-1076-4c63-a2eb-348097b491d4 None None] SCRIPT_NAME: `/identity` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:20:02.042081 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b8dfcd-1076-4c63-a2eb-348097b491d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:20:02.061615 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.auth.core [None req-39b8dfcd-1076-4c63-a2eb-348097b491d4 None None] MFA Rules not processed for user `819d41a279e64291acc60de51e1530ae`. Rule list: `[]` (Enabled: `True`). {{(pid=88551) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 19:20:02.062834 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.common.fernet_utils [None req-39b8dfcd-1076-4c63-a2eb-348097b491d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:20:02.122813 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: [pid: 88551|app: 0|req: 556/1125] 10.222.0.26 () {58 vars in 958 bytes} [Wed Aug 17 19:20:02 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 19:20:02.133939 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dc389a8-7c62-4d00-8f72-b6344bf31372 admin admin] Authenticating user token {{(pid=88550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:20:02.135374 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.common.fernet_utils [None req-8dc389a8-7c62-4d00-8f72-b6344bf31372 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:20:02.208196 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dc389a8-7c62-4d00-8f72-b6344bf31372 admin admin] Validating token access rules against request {{(pid=88550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:20:02.212009 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5cda502-8cce-4592-a5c6-3f1a0a955e77 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8240f6e0b65545708f07e040c09e1490', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4bbf6c5abd684d899d09a08b0847d81c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:20:02.213002 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5cda502-8cce-4592-a5c6-3f1a0a955e77 service neutron] REQUEST_METHOD: `GET` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:20:02.213277 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5cda502-8cce-4592-a5c6-3f1a0a955e77 service neutron] SCRIPT_NAME: `/identity` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:20:02.213544 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5cda502-8cce-4592-a5c6-3f1a0a955e77 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:20:02.223097 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5cda502-8cce-4592-a5c6-3f1a0a955e77 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:20:02.224563 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5cda502-8cce-4592-a5c6-3f1a0a955e77 service neutron] RBAC: Authorization granted {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:20:02.235144 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: [pid: 88550|app: 0|req: 570/1126] 10.222.0.26 () {60 vars in 1365 bytes} [Wed Aug 17 19:20:02 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 19:20:02.690696 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39b8dfcd-1076-4c63-a2eb-348097b491d4 None None] Authenticating user token {{(pid=88551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:20:02.692775 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.common.fernet_utils [None req-39b8dfcd-1076-4c63-a2eb-348097b491d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:20:02.704668 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39b8dfcd-1076-4c63-a2eb-348097b491d4 None None] Validating token access rules against request {{(pid=88551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:20:02.710460 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09e22668-0d5b-45b4-ba86-d1634066b8ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '819d41a279e64291acc60de51e1530ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0490e0db9a14e81a7ea7b108a7ad6a0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:20:02.711121 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e22668-0d5b-45b4-ba86-d1634066b8ac admin admin] REQUEST_METHOD: `DELETE` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:20:02.711457 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e22668-0d5b-45b4-ba86-d1634066b8ac admin admin] SCRIPT_NAME: `/identity` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:20:02.711654 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e22668-0d5b-45b4-ba86-d1634066b8ac admin admin] PATH_INFO: `/v3/projects/fc9e630381a643d499750a759eee9312` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:20:02.712785 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09e22668-0d5b-45b4-ba86-d1634066b8ac admin admin] RBAC: Authorizing `identity:delete_project(project_id=fc9e630381a643d499750a759eee9312)` {{(pid=88551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:20:02.715256 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: WARNING py.warnings [None req-09e22668-0d5b-45b4-ba86-d1634066b8ac admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 17 19:20:02.715256 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: warnings.warn(msg) Aug 17 19:20:02.715256 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: Aug 17 19:20:02.716541 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09e22668-0d5b-45b4-ba86-d1634066b8ac admin admin] RBAC: Authorization granted {{(pid=88551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:20:02.874642 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.notifications [None req-09e22668-0d5b-45b4-ba86-d1634066b8ac admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fc9e630381a643d499750a759eee9312', 'request_id': 'req-09e22668-0d5b-45b4-ba86-d1634066b8ac'} {{(pid=88551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 19:20:02.991305 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.notifications [None req-09e22668-0d5b-45b4-ba86-d1634066b8ac admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fc9e630381a643d499750a759eee9312', 'request_id': 'req-09e22668-0d5b-45b4-ba86-d1634066b8ac'} {{(pid=88551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 19:20:03.005638 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.notifications [None req-09e22668-0d5b-45b4-ba86-d1634066b8ac admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fc9e630381a643d499750a759eee9312', 'request_id': 'req-09e22668-0d5b-45b4-ba86-d1634066b8ac'} {{(pid=88551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 19:20:03.016697 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.notifications [None req-09e22668-0d5b-45b4-ba86-d1634066b8ac admin admin] The token cache is being invalidate because project fc9e630381a643d499750a759eee9312 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88551) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 17 19:20:03.016983 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.notifications [None req-09e22668-0d5b-45b4-ba86-d1634066b8ac admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 19:20:03.017640 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.notifications [None req-09e22668-0d5b-45b4-ba86-d1634066b8ac admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 19:20:03.019267 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: [pid: 88551|app: 0|req: 557/1127] 10.222.0.26 () {58 vars in 1233 bytes} [Wed Aug 17 19:20:02 2022] DELETE /identity/v3/projects/fc9e630381a643d499750a759eee9312 => generated 0 bytes in 329 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 19:20:12.232804 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG dbcounter [-] [88550] Writing DB stats keystone:DELETE=1,keystone:SELECT=33 {{(pid=88550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:20:13.013596 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG dbcounter [-] [88551] Writing DB stats keystone:SELECT=60,keystone:DELETE=7,keystone:INSERT=1 {{(pid=88551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:21:27.237035 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd40845d-7c8f-418d-89e4-7d03f5add228 None None] REQUEST_METHOD: `GET` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:21:27.237647 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd40845d-7c8f-418d-89e4-7d03f5add228 None None] SCRIPT_NAME: `/identity` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:21:27.237647 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd40845d-7c8f-418d-89e4-7d03f5add228 None None] PATH_INFO: `/` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:21:27.238975 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: [pid: 88550|app: 0|req: 571/1128] 127.0.0.1 () {54 vars in 901 bytes} [Wed Aug 17 19:21:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 19:21:27.243780 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20539b29-eba5-4442-ac12-56e2c1bb50e6 None None] REQUEST_METHOD: `POST` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:21:27.244215 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20539b29-eba5-4442-ac12-56e2c1bb50e6 None None] SCRIPT_NAME: `/identity` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:21:27.244318 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20539b29-eba5-4442-ac12-56e2c1bb50e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:21:27.264180 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.auth.core [None req-20539b29-eba5-4442-ac12-56e2c1bb50e6 None None] MFA Rules not processed for user `819d41a279e64291acc60de51e1530ae`. Rule list: `[]` (Enabled: `True`). {{(pid=88551) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 19:21:27.265378 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.common.fernet_utils [None req-20539b29-eba5-4442-ac12-56e2c1bb50e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:21:27.325245 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: [pid: 88551|app: 0|req: 558/1129] 127.0.0.1 () {58 vars in 998 bytes} [Wed Aug 17 19:21:27 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 19:21:27.483563 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd40845d-7c8f-418d-89e4-7d03f5add228 None None] Authenticating user token {{(pid=88550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:21:27.485454 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.common.fernet_utils [None req-fd40845d-7c8f-418d-89e4-7d03f5add228 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:21:27.557819 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd40845d-7c8f-418d-89e4-7d03f5add228 None None] Validating token access rules against request {{(pid=88550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:21:27.563067 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f663dea-4fe1-4159-918a-34fc2b44cc43 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ae23e7a10d54989a25c9f3019184d01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4bbf6c5abd684d899d09a08b0847d81c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:21:27.563675 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f663dea-4fe1-4159-918a-34fc2b44cc43 service nova] REQUEST_METHOD: `GET` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:21:27.563946 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f663dea-4fe1-4159-918a-34fc2b44cc43 service nova] SCRIPT_NAME: `/identity` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:21:27.564214 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f663dea-4fe1-4159-918a-34fc2b44cc43 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:21:27.576533 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f663dea-4fe1-4159-918a-34fc2b44cc43 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:21:27.578131 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f663dea-4fe1-4159-918a-34fc2b44cc43 service nova] RBAC: Authorization granted {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:21:27.587919 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: [pid: 88550|app: 0|req: 572/1130] 10.222.0.26 () {60 vars in 1365 bytes} [Wed Aug 17 19:21:27 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 19:21:28.421942 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a52852e-d7bb-420d-974e-6f6253b37d30 None None] REQUEST_METHOD: `GET` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:21:28.422507 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a52852e-d7bb-420d-974e-6f6253b37d30 None None] SCRIPT_NAME: `/identity` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:21:28.422507 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a52852e-d7bb-420d-974e-6f6253b37d30 None None] PATH_INFO: `/` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:21:28.423830 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: [pid: 88551|app: 0|req: 559/1131] 127.0.0.1 () {54 vars in 901 bytes} [Wed Aug 17 19:21:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 19:21:28.428731 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ac66b0-0744-4279-a2b6-ba521e60c35c None None] REQUEST_METHOD: `POST` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:21:28.429205 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ac66b0-0744-4279-a2b6-ba521e60c35c None None] SCRIPT_NAME: `/identity` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:21:28.429498 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ac66b0-0744-4279-a2b6-ba521e60c35c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:21:28.452122 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.auth.core [None req-25ac66b0-0744-4279-a2b6-ba521e60c35c None None] MFA Rules not processed for user `819d41a279e64291acc60de51e1530ae`. Rule list: `[]` (Enabled: `True`). {{(pid=88550) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 19:21:28.453339 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.common.fernet_utils [None req-25ac66b0-0744-4279-a2b6-ba521e60c35c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:21:28.461418 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: [pid: 88550|app: 0|req: 573/1132] 127.0.0.1 () {58 vars in 998 bytes} [Wed Aug 17 19:21:28 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 19:21:28.623925 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a52852e-d7bb-420d-974e-6f6253b37d30 None None] Authenticating user token {{(pid=88551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:21:28.637213 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a52852e-d7bb-420d-974e-6f6253b37d30 None None] Validating token access rules against request {{(pid=88551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:21:28.642240 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d262f45f-2922-42f7-bc3a-ec4d263b8036 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ae23e7a10d54989a25c9f3019184d01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4bbf6c5abd684d899d09a08b0847d81c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:21:28.642872 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d262f45f-2922-42f7-bc3a-ec4d263b8036 service nova] REQUEST_METHOD: `GET` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:21:28.643152 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d262f45f-2922-42f7-bc3a-ec4d263b8036 service nova] SCRIPT_NAME: `/identity` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:21:28.643423 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d262f45f-2922-42f7-bc3a-ec4d263b8036 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:21:28.651779 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d262f45f-2922-42f7-bc3a-ec4d263b8036 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:21:28.653401 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d262f45f-2922-42f7-bc3a-ec4d263b8036 service nova] RBAC: Authorization granted {{(pid=88551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:21:28.663073 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: [pid: 88551|app: 0|req: 560/1133] 10.222.0.26 () {60 vars in 1365 bytes} [Wed Aug 17 19:21:28 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 17 19:21:33.230864 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c08ab0-204a-4a2e-922a-94ee1374583a None None] REQUEST_METHOD: `GET` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:21:33.231912 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c08ab0-204a-4a2e-922a-94ee1374583a None None] SCRIPT_NAME: `/identity` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:21:33.231912 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c08ab0-204a-4a2e-922a-94ee1374583a None None] PATH_INFO: `/v3` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:21:33.233260 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: [pid: 88550|app: 0|req: 574/1134] 10.222.0.55 () {54 vars in 925 bytes} [Wed Aug 17 19:21:33 2022] GET /identity/v3 => generated 255 bytes in 4 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 19:21:33.239329 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae7890f-66d5-4877-96fb-32cf363999e9 None None] REQUEST_METHOD: `POST` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:21:33.239828 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae7890f-66d5-4877-96fb-32cf363999e9 None None] SCRIPT_NAME: `/identity` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:21:33.239924 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae7890f-66d5-4877-96fb-32cf363999e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:21:33.272232 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.auth.core [None req-bae7890f-66d5-4877-96fb-32cf363999e9 None None] MFA Rules not processed for user `6478a47e33024d1abc99f078dbc30787`. Rule list: `[]` (Enabled: `True`). {{(pid=88551) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 19:21:33.273492 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.common.fernet_utils [None req-bae7890f-66d5-4877-96fb-32cf363999e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:21:33.337512 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: [pid: 88551|app: 0|req: 561/1135] 10.222.0.55 () {58 vars in 1015 bytes} [Wed Aug 17 19:21:33 2022] POST /identity/v3/auth/tokens => generated 2868 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 19:21:38.446626 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG dbcounter [-] [88550] Writing DB stats keystone:SELECT=35 {{(pid=88550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:21:39.939587 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-777c3d3d-9499-41f5-9e5f-72bad93a0bd3 None None] REQUEST_METHOD: `GET` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:21:39.940266 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-777c3d3d-9499-41f5-9e5f-72bad93a0bd3 None None] SCRIPT_NAME: `/identity` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:21:39.940266 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-777c3d3d-9499-41f5-9e5f-72bad93a0bd3 None None] PATH_INFO: `/` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:21:39.941460 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: [pid: 88550|app: 0|req: 575/1136] 127.0.0.1 () {54 vars in 901 bytes} [Wed Aug 17 19:21:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 19:21:39.946947 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4640f65f-66d0-4ebd-9931-12531c60f141 None None] REQUEST_METHOD: `POST` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:21:39.946947 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4640f65f-66d0-4ebd-9931-12531c60f141 None None] SCRIPT_NAME: `/identity` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:21:39.947370 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4640f65f-66d0-4ebd-9931-12531c60f141 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:21:39.970116 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.auth.core [None req-4640f65f-66d0-4ebd-9931-12531c60f141 None None] MFA Rules not processed for user `819d41a279e64291acc60de51e1530ae`. Rule list: `[]` (Enabled: `True`). {{(pid=88551) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 19:21:39.971363 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.common.fernet_utils [None req-4640f65f-66d0-4ebd-9931-12531c60f141 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:21:39.979084 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: [pid: 88551|app: 0|req: 562/1137] 127.0.0.1 () {58 vars in 998 bytes} [Wed Aug 17 19:21:39 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 19:21:40.142367 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-777c3d3d-9499-41f5-9e5f-72bad93a0bd3 None None] Authenticating user token {{(pid=88550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:21:40.157549 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-777c3d3d-9499-41f5-9e5f-72bad93a0bd3 None None] Validating token access rules against request {{(pid=88550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:21:40.162730 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66b0e801-33c5-49a9-8e00-6d759c7fdf48 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ae23e7a10d54989a25c9f3019184d01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4bbf6c5abd684d899d09a08b0847d81c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:21:40.163320 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b0e801-33c5-49a9-8e00-6d759c7fdf48 service nova] REQUEST_METHOD: `GET` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:21:40.163603 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b0e801-33c5-49a9-8e00-6d759c7fdf48 service nova] SCRIPT_NAME: `/identity` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:21:40.163880 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b0e801-33c5-49a9-8e00-6d759c7fdf48 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:21:40.172750 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66b0e801-33c5-49a9-8e00-6d759c7fdf48 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:21:40.174326 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66b0e801-33c5-49a9-8e00-6d759c7fdf48 service nova] RBAC: Authorization granted {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:21:40.183935 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: [pid: 88550|app: 0|req: 576/1138] 10.222.0.26 () {60 vars in 1365 bytes} [Wed Aug 17 19:21:40 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 19:21:41.015875 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b6c78a-876e-4498-8fc4-1b531d9841c8 None None] REQUEST_METHOD: `GET` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:21:41.016408 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b6c78a-876e-4498-8fc4-1b531d9841c8 None None] SCRIPT_NAME: `/identity` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:21:41.016408 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b6c78a-876e-4498-8fc4-1b531d9841c8 None None] PATH_INFO: `/` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:21:41.017792 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: [pid: 88551|app: 0|req: 563/1139] 127.0.0.1 () {54 vars in 901 bytes} [Wed Aug 17 19:21:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 19:21:41.022859 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b3d32c-c891-420b-bdf7-cb19adcaffb5 None None] REQUEST_METHOD: `POST` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:21:41.023293 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b3d32c-c891-420b-bdf7-cb19adcaffb5 None None] SCRIPT_NAME: `/identity` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:21:41.023401 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b3d32c-c891-420b-bdf7-cb19adcaffb5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:21:41.043530 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.auth.core [None req-c6b3d32c-c891-420b-bdf7-cb19adcaffb5 None None] MFA Rules not processed for user `819d41a279e64291acc60de51e1530ae`. Rule list: `[]` (Enabled: `True`). {{(pid=88550) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 19:21:41.047673 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.common.fernet_utils [None req-c6b3d32c-c891-420b-bdf7-cb19adcaffb5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:21:41.054841 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: [pid: 88550|app: 0|req: 577/1140] 127.0.0.1 () {58 vars in 998 bytes} [Wed Aug 17 19:21:41 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 19:21:41.213796 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07b6c78a-876e-4498-8fc4-1b531d9841c8 None None] Authenticating user token {{(pid=88551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:21:41.228083 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07b6c78a-876e-4498-8fc4-1b531d9841c8 None None] Validating token access rules against request {{(pid=88551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:21:41.233041 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba96830c-291d-4ab4-aa91-c77f4b33d949 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ae23e7a10d54989a25c9f3019184d01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4bbf6c5abd684d899d09a08b0847d81c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:21:41.233659 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba96830c-291d-4ab4-aa91-c77f4b33d949 service nova] REQUEST_METHOD: `GET` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:21:41.233936 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba96830c-291d-4ab4-aa91-c77f4b33d949 service nova] SCRIPT_NAME: `/identity` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:21:41.234208 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba96830c-291d-4ab4-aa91-c77f4b33d949 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:21:41.243025 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba96830c-291d-4ab4-aa91-c77f4b33d949 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:21:41.244792 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba96830c-291d-4ab4-aa91-c77f4b33d949 service nova] RBAC: Authorization granted {{(pid=88551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:21:41.255297 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: [pid: 88551|app: 0|req: 564/1141] 10.222.0.26 () {60 vars in 1365 bytes} [Wed Aug 17 19:21:41 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 19:21:42.680234 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d26b8636-a718-4215-adc7-7ffeba9e8ada None None] REQUEST_METHOD: `GET` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:21:42.680803 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d26b8636-a718-4215-adc7-7ffeba9e8ada None None] SCRIPT_NAME: `/identity` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:21:42.680803 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d26b8636-a718-4215-adc7-7ffeba9e8ada None None] PATH_INFO: `/` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:21:42.682194 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: [pid: 88550|app: 0|req: 578/1142] 10.222.0.26 () {54 vars in 961 bytes} [Wed Aug 17 19:21:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 19:21:42.689008 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f88e122-38fd-4f8f-8e0d-91e55acb8e83 None None] REQUEST_METHOD: `POST` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:21:42.689647 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f88e122-38fd-4f8f-8e0d-91e55acb8e83 None None] SCRIPT_NAME: `/identity` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:21:42.689647 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f88e122-38fd-4f8f-8e0d-91e55acb8e83 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:21:42.711189 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.auth.core [None req-0f88e122-38fd-4f8f-8e0d-91e55acb8e83 None None] MFA Rules not processed for user `6478a47e33024d1abc99f078dbc30787`. Rule list: `[]` (Enabled: `True`). {{(pid=88551) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 19:21:42.712443 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.common.fernet_utils [None req-0f88e122-38fd-4f8f-8e0d-91e55acb8e83 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:21:42.721551 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: [pid: 88551|app: 0|req: 565/1143] 10.222.0.26 () {58 vars in 1058 bytes} [Wed Aug 17 19:21:42 2022] POST /identity/v3/auth/tokens => generated 2868 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 19:21:42.729299 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d26b8636-a718-4215-adc7-7ffeba9e8ada None None] Authenticating user token {{(pid=88550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:21:42.743876 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d26b8636-a718-4215-adc7-7ffeba9e8ada None None] Validating token access rules against request {{(pid=88550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:21:42.750124 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0392e0e9-5b82-4384-8de3-3740778657d6 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6478a47e33024d1abc99f078dbc30787', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4bbf6c5abd684d899d09a08b0847d81c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:21:42.750783 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0392e0e9-5b82-4384-8de3-3740778657d6 service placement] REQUEST_METHOD: `GET` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:21:42.751067 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0392e0e9-5b82-4384-8de3-3740778657d6 service placement] SCRIPT_NAME: `/identity` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:21:42.751342 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0392e0e9-5b82-4384-8de3-3740778657d6 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:21:42.761132 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0392e0e9-5b82-4384-8de3-3740778657d6 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:21:42.762836 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0392e0e9-5b82-4384-8de3-3740778657d6 service placement] RBAC: Authorization granted {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:21:42.774053 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: [pid: 88550|app: 0|req: 579/1144] 10.222.0.26 () {60 vars in 1365 bytes} [Wed Aug 17 19:21:42 2022] GET /identity/v3/auth/tokens => generated 2868 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 19:21:52.508279 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01497d1e-ba87-42e0-8968-8b4415db5ae0 None None] REQUEST_METHOD: `GET` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:21:52.508881 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01497d1e-ba87-42e0-8968-8b4415db5ae0 None None] SCRIPT_NAME: `/identity` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:21:52.508881 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01497d1e-ba87-42e0-8968-8b4415db5ae0 None None] PATH_INFO: `/` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:21:52.510212 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: [pid: 88551|app: 0|req: 566/1145] 127.0.0.1 () {54 vars in 901 bytes} [Wed Aug 17 19:21:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 19:21:52.515133 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db9eeb9-c2c1-4b45-907d-3a2c066c300c None None] REQUEST_METHOD: `POST` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:21:52.515532 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db9eeb9-c2c1-4b45-907d-3a2c066c300c None None] SCRIPT_NAME: `/identity` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:21:52.515643 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db9eeb9-c2c1-4b45-907d-3a2c066c300c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:21:52.539805 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.auth.core [None req-3db9eeb9-c2c1-4b45-907d-3a2c066c300c None None] MFA Rules not processed for user `819d41a279e64291acc60de51e1530ae`. Rule list: `[]` (Enabled: `True`). {{(pid=88550) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 19:21:52.540957 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.common.fernet_utils [None req-3db9eeb9-c2c1-4b45-907d-3a2c066c300c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:21:52.548991 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: [pid: 88550|app: 0|req: 580/1146] 127.0.0.1 () {58 vars in 998 bytes} [Wed Aug 17 19:21:52 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 19:21:52.705497 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG dbcounter [-] [88551] Writing DB stats keystone:SELECT=79 {{(pid=88551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:21:52.708536 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01497d1e-ba87-42e0-8968-8b4415db5ae0 None None] Authenticating user token {{(pid=88551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:21:52.721820 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01497d1e-ba87-42e0-8968-8b4415db5ae0 None None] Validating token access rules against request {{(pid=88551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:21:52.726790 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9115f641-1754-4295-92c7-4ece6631d26f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ae23e7a10d54989a25c9f3019184d01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4bbf6c5abd684d899d09a08b0847d81c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:21:52.727374 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9115f641-1754-4295-92c7-4ece6631d26f service nova] REQUEST_METHOD: `GET` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:21:52.727649 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9115f641-1754-4295-92c7-4ece6631d26f service nova] SCRIPT_NAME: `/identity` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:21:52.727920 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9115f641-1754-4295-92c7-4ece6631d26f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:21:52.736340 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9115f641-1754-4295-92c7-4ece6631d26f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:21:52.737910 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9115f641-1754-4295-92c7-4ece6631d26f service nova] RBAC: Authorization granted {{(pid=88551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:21:52.747556 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: [pid: 88551|app: 0|req: 567/1147] 10.222.0.26 () {60 vars in 1365 bytes} [Wed Aug 17 19:21:52 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 19:21:53.574487 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-724010e7-13ac-4ca7-8428-b2186c5e206b None None] REQUEST_METHOD: `GET` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:21:53.575076 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-724010e7-13ac-4ca7-8428-b2186c5e206b None None] SCRIPT_NAME: `/identity` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:21:53.575076 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-724010e7-13ac-4ca7-8428-b2186c5e206b None None] PATH_INFO: `/` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:21:53.576400 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: [pid: 88550|app: 0|req: 581/1148] 127.0.0.1 () {54 vars in 901 bytes} [Wed Aug 17 19:21:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 19:21:53.581337 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14565ef9-e445-4a17-a405-c6c53f6860c9 None None] REQUEST_METHOD: `POST` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:21:53.581741 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14565ef9-e445-4a17-a405-c6c53f6860c9 None None] SCRIPT_NAME: `/identity` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:21:53.581870 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14565ef9-e445-4a17-a405-c6c53f6860c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:21:53.601536 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.auth.core [None req-14565ef9-e445-4a17-a405-c6c53f6860c9 None None] MFA Rules not processed for user `819d41a279e64291acc60de51e1530ae`. Rule list: `[]` (Enabled: `True`). {{(pid=88551) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 19:21:53.602773 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.common.fernet_utils [None req-14565ef9-e445-4a17-a405-c6c53f6860c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:21:53.611026 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: [pid: 88551|app: 0|req: 568/1149] 127.0.0.1 () {58 vars in 998 bytes} [Wed Aug 17 19:21:53 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 19:21:53.765506 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-724010e7-13ac-4ca7-8428-b2186c5e206b None None] Authenticating user token {{(pid=88550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:21:53.779070 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-724010e7-13ac-4ca7-8428-b2186c5e206b None None] Validating token access rules against request {{(pid=88550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:21:53.787020 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a60605b8-f71b-4a80-8afd-dbffcd6c8c3e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ae23e7a10d54989a25c9f3019184d01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4bbf6c5abd684d899d09a08b0847d81c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:21:53.787618 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a60605b8-f71b-4a80-8afd-dbffcd6c8c3e service nova] REQUEST_METHOD: `GET` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:21:53.787893 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a60605b8-f71b-4a80-8afd-dbffcd6c8c3e service nova] SCRIPT_NAME: `/identity` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:21:53.788175 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a60605b8-f71b-4a80-8afd-dbffcd6c8c3e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:21:53.796896 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a60605b8-f71b-4a80-8afd-dbffcd6c8c3e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:21:53.799164 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a60605b8-f71b-4a80-8afd-dbffcd6c8c3e service nova] RBAC: Authorization granted {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:21:53.808828 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: [pid: 88550|app: 0|req: 582/1150] 10.222.0.26 () {60 vars in 1365 bytes} [Wed Aug 17 19:21:53 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 19:21:58.271032 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b7a2af-b91d-4084-942b-eeaf42e6ebf8 None None] REQUEST_METHOD: `GET` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:21:58.271632 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b7a2af-b91d-4084-942b-eeaf42e6ebf8 None None] SCRIPT_NAME: `/identity` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:21:58.271632 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b7a2af-b91d-4084-942b-eeaf42e6ebf8 None None] PATH_INFO: `/` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:21:58.272907 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: [pid: 88551|app: 0|req: 569/1151] 127.0.0.1 () {54 vars in 917 bytes} [Wed Aug 17 19:21:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 19:21:58.278252 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b66ea6-a746-492a-83a1-0e7815e538e2 None None] REQUEST_METHOD: `POST` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:21:58.278686 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b66ea6-a746-492a-83a1-0e7815e538e2 None None] SCRIPT_NAME: `/identity` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:21:58.278933 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b66ea6-a746-492a-83a1-0e7815e538e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:21:58.298302 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.auth.core [None req-45b66ea6-a746-492a-83a1-0e7815e538e2 None None] MFA Rules not processed for user `819d41a279e64291acc60de51e1530ae`. Rule list: `[]` (Enabled: `True`). {{(pid=88550) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 19:21:58.300055 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.common.fernet_utils [None req-45b66ea6-a746-492a-83a1-0e7815e538e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:21:58.307834 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: [pid: 88550|app: 0|req: 583/1152] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Aug 17 19:21:58 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 19:21:58.651614 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66b7a2af-b91d-4084-942b-eeaf42e6ebf8 None None] Authenticating user token {{(pid=88551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:21:58.653316 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.common.fernet_utils [None req-66b7a2af-b91d-4084-942b-eeaf42e6ebf8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:21:58.711302 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66b7a2af-b91d-4084-942b-eeaf42e6ebf8 None None] Validating token access rules against request {{(pid=88551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:21:58.715032 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01ca9446-85da-4e91-9337-cc962960a51f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8240f6e0b65545708f07e040c09e1490', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4bbf6c5abd684d899d09a08b0847d81c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:21:58.715655 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ca9446-85da-4e91-9337-cc962960a51f service neutron] REQUEST_METHOD: `GET` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:21:58.715934 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ca9446-85da-4e91-9337-cc962960a51f service neutron] SCRIPT_NAME: `/identity` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:21:58.716204 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ca9446-85da-4e91-9337-cc962960a51f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:21:58.726218 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01ca9446-85da-4e91-9337-cc962960a51f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:21:58.727747 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01ca9446-85da-4e91-9337-cc962960a51f service neutron] RBAC: Authorization granted {{(pid=88551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:21:58.737536 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: [pid: 88551|app: 0|req: 570/1153] 10.222.0.26 () {60 vars in 1365 bytes} [Wed Aug 17 19:21:58 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 19:22:00.932849 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df3fadfe-4984-4dae-8d36-032104c4ac6c None None] REQUEST_METHOD: `GET` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:22:00.933421 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df3fadfe-4984-4dae-8d36-032104c4ac6c None None] SCRIPT_NAME: `/identity` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:22:00.933421 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df3fadfe-4984-4dae-8d36-032104c4ac6c None None] PATH_INFO: `/` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:22:00.934785 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: [pid: 88550|app: 0|req: 584/1154] 127.0.0.1 () {54 vars in 917 bytes} [Wed Aug 17 19:22:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 19:22:00.940696 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4296cd5b-9d8a-43cd-8806-84d05b94413b None None] REQUEST_METHOD: `POST` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:22:00.941118 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4296cd5b-9d8a-43cd-8806-84d05b94413b None None] SCRIPT_NAME: `/identity` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:22:00.941251 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4296cd5b-9d8a-43cd-8806-84d05b94413b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:22:00.961461 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.auth.core [None req-4296cd5b-9d8a-43cd-8806-84d05b94413b None None] MFA Rules not processed for user `819d41a279e64291acc60de51e1530ae`. Rule list: `[]` (Enabled: `True`). {{(pid=88551) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 19:22:00.962699 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.common.fernet_utils [None req-4296cd5b-9d8a-43cd-8806-84d05b94413b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:22:00.970440 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: [pid: 88551|app: 0|req: 571/1155] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Aug 17 19:22:00 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 19:22:01.323452 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df3fadfe-4984-4dae-8d36-032104c4ac6c None None] Authenticating user token {{(pid=88550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:22:01.335314 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df3fadfe-4984-4dae-8d36-032104c4ac6c None None] Validating token access rules against request {{(pid=88550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:22:01.339016 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-077391c2-c0f5-4a99-a890-808e26679fe4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8240f6e0b65545708f07e040c09e1490', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4bbf6c5abd684d899d09a08b0847d81c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:22:01.339599 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-077391c2-c0f5-4a99-a890-808e26679fe4 service neutron] REQUEST_METHOD: `GET` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:22:01.339876 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-077391c2-c0f5-4a99-a890-808e26679fe4 service neutron] SCRIPT_NAME: `/identity` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:22:01.340427 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-077391c2-c0f5-4a99-a890-808e26679fe4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:22:01.350169 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-077391c2-c0f5-4a99-a890-808e26679fe4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:22:01.351641 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-077391c2-c0f5-4a99-a890-808e26679fe4 service neutron] RBAC: Authorization granted {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:22:01.361219 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: [pid: 88550|app: 0|req: 585/1156] 10.222.0.26 () {60 vars in 1365 bytes} [Wed Aug 17 19:22:01 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 19:22:05.255413 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec70c11-10b7-44d8-97ff-dec229faa01d None None] REQUEST_METHOD: `GET` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:22:05.255975 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec70c11-10b7-44d8-97ff-dec229faa01d None None] SCRIPT_NAME: `/identity` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:22:05.255975 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec70c11-10b7-44d8-97ff-dec229faa01d None None] PATH_INFO: `/` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:22:05.257458 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: [pid: 88551|app: 0|req: 572/1157] 127.0.0.1 () {54 vars in 917 bytes} [Wed Aug 17 19:22:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 19:22:05.262594 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d18e5b0-54ab-4725-b5e0-876b817eabf2 None None] REQUEST_METHOD: `POST` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:22:05.263028 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d18e5b0-54ab-4725-b5e0-876b817eabf2 None None] SCRIPT_NAME: `/identity` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:22:05.263125 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d18e5b0-54ab-4725-b5e0-876b817eabf2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:22:05.282105 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.auth.core [None req-7d18e5b0-54ab-4725-b5e0-876b817eabf2 None None] MFA Rules not processed for user `819d41a279e64291acc60de51e1530ae`. Rule list: `[]` (Enabled: `True`). {{(pid=88550) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 19:22:05.283332 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.common.fernet_utils [None req-7d18e5b0-54ab-4725-b5e0-876b817eabf2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:22:05.291756 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: [pid: 88550|app: 0|req: 586/1158] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Aug 17 19:22:05 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 19:22:05.865395 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aec70c11-10b7-44d8-97ff-dec229faa01d None None] Authenticating user token {{(pid=88551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:22:05.867100 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.common.fernet_utils [None req-aec70c11-10b7-44d8-97ff-dec229faa01d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:22:05.928718 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aec70c11-10b7-44d8-97ff-dec229faa01d None None] Validating token access rules against request {{(pid=88551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:22:05.932711 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ded99636-d2bf-4c28-b742-f4aea477da75 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a7ec0aa480147f897f8a76b5b29f3c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4bbf6c5abd684d899d09a08b0847d81c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:22:05.933345 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded99636-d2bf-4c28-b742-f4aea477da75 service cinder] REQUEST_METHOD: `GET` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:22:05.933621 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded99636-d2bf-4c28-b742-f4aea477da75 service cinder] SCRIPT_NAME: `/identity` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:22:05.933894 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded99636-d2bf-4c28-b742-f4aea477da75 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:22:05.945328 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ded99636-d2bf-4c28-b742-f4aea477da75 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:22:05.946829 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ded99636-d2bf-4c28-b742-f4aea477da75 service cinder] RBAC: Authorization granted {{(pid=88551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:22:05.957472 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: [pid: 88551|app: 0|req: 573/1159] 10.222.0.26 () {60 vars in 1365 bytes} [Wed Aug 17 19:22:05 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 19:22:08.188608 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-648e1320-a1fe-4f00-a8fd-bfd930f7bf3e None None] REQUEST_METHOD: `GET` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:22:08.189205 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-648e1320-a1fe-4f00-a8fd-bfd930f7bf3e None None] SCRIPT_NAME: `/identity` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:22:08.189205 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-648e1320-a1fe-4f00-a8fd-bfd930f7bf3e None None] PATH_INFO: `/` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:22:08.190527 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: [pid: 88550|app: 0|req: 587/1160] 127.0.0.1 () {54 vars in 917 bytes} [Wed Aug 17 19:22:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 19:22:08.195679 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-437756a0-bcc8-4324-a46e-d4e8b52122b9 None None] REQUEST_METHOD: `POST` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:22:08.196131 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-437756a0-bcc8-4324-a46e-d4e8b52122b9 None None] SCRIPT_NAME: `/identity` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:22:08.196242 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-437756a0-bcc8-4324-a46e-d4e8b52122b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:22:08.216714 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.auth.core [None req-437756a0-bcc8-4324-a46e-d4e8b52122b9 None None] MFA Rules not processed for user `819d41a279e64291acc60de51e1530ae`. Rule list: `[]` (Enabled: `True`). {{(pid=88551) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 19:22:08.217845 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.common.fernet_utils [None req-437756a0-bcc8-4324-a46e-d4e8b52122b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:22:08.226183 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: [pid: 88551|app: 0|req: 574/1161] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Aug 17 19:22:08 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 19:22:08.822394 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-648e1320-a1fe-4f00-a8fd-bfd930f7bf3e None None] Authenticating user token {{(pid=88550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:22:08.824129 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.common.fernet_utils [None req-648e1320-a1fe-4f00-a8fd-bfd930f7bf3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:22:08.831848 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG dbcounter [-] [88550] Writing DB stats keystone:SELECT=37 {{(pid=88550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:22:08.837663 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-648e1320-a1fe-4f00-a8fd-bfd930f7bf3e None None] Validating token access rules against request {{(pid=88550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:22:08.841269 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d14d17e5-4f0d-4df6-9499-575a22933efc service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a7ec0aa480147f897f8a76b5b29f3c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4bbf6c5abd684d899d09a08b0847d81c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:22:08.841862 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d14d17e5-4f0d-4df6-9499-575a22933efc service cinder] REQUEST_METHOD: `GET` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:22:08.842141 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d14d17e5-4f0d-4df6-9499-575a22933efc service cinder] SCRIPT_NAME: `/identity` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:22:08.842416 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d14d17e5-4f0d-4df6-9499-575a22933efc service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:22:08.852807 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d14d17e5-4f0d-4df6-9499-575a22933efc service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:22:08.854287 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d14d17e5-4f0d-4df6-9499-575a22933efc service cinder] RBAC: Authorization granted {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:22:08.864333 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: [pid: 88550|app: 0|req: 588/1162] 10.222.0.26 () {60 vars in 1365 bytes} [Wed Aug 17 19:22:08 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 19:22:18.211973 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG dbcounter [-] [88551] Writing DB stats keystone:SELECT=67 {{(pid=88551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:22:18.886103 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG dbcounter [-] [88550] Writing DB stats keystone:SELECT=5 {{(pid=88550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:23:24.587273 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed062dc3-c640-472b-8369-19477ef18e5c None None] REQUEST_METHOD: `POST` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:23:24.587872 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed062dc3-c640-472b-8369-19477ef18e5c None None] SCRIPT_NAME: `/identity` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:23:24.587872 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed062dc3-c640-472b-8369-19477ef18e5c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:23:24.595787 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a31deee1-3622-4c34-9cf3-0183174e8068 None None] REQUEST_METHOD: `POST` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:23:24.596304 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a31deee1-3622-4c34-9cf3-0183174e8068 None None] SCRIPT_NAME: `/identity` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:23:24.596396 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a31deee1-3622-4c34-9cf3-0183174e8068 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:23:24.608356 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.auth.core [None req-ed062dc3-c640-472b-8369-19477ef18e5c None None] MFA Rules not processed for user `819d41a279e64291acc60de51e1530ae`. Rule list: `[]` (Enabled: `True`). {{(pid=88551) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 19:23:24.609555 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.common.fernet_utils [None req-ed062dc3-c640-472b-8369-19477ef18e5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:23:24.615870 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.auth.core [None req-a31deee1-3622-4c34-9cf3-0183174e8068 None None] MFA Rules not processed for user `819d41a279e64291acc60de51e1530ae`. Rule list: `[]` (Enabled: `True`). {{(pid=88550) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 19:23:24.620797 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.common.fernet_utils [None req-a31deee1-3622-4c34-9cf3-0183174e8068 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:23:24.620928 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: [pid: 88551|app: 0|req: 575/1163] 10.222.0.26 () {58 vars in 958 bytes} [Wed Aug 17 19:23:24 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 17 19:23:24.626209 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: [pid: 88550|app: 0|req: 589/1164] 10.222.0.26 () {58 vars in 958 bytes} [Wed Aug 17 19:23:24 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 17 19:23:24.626622 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08dad8f6-3004-4b1c-a9c7-7de8ce931b7b None None] REQUEST_METHOD: `POST` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:23:24.627102 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08dad8f6-3004-4b1c-a9c7-7de8ce931b7b None None] SCRIPT_NAME: `/identity` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:23:24.627379 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08dad8f6-3004-4b1c-a9c7-7de8ce931b7b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:23:24.633741 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c8880b-a5a7-4140-95af-206893bc6335 None None] REQUEST_METHOD: `POST` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:23:24.634019 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c8880b-a5a7-4140-95af-206893bc6335 None None] SCRIPT_NAME: `/identity` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:23:24.634295 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c8880b-a5a7-4140-95af-206893bc6335 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:23:24.647073 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.auth.core [None req-08dad8f6-3004-4b1c-a9c7-7de8ce931b7b None None] MFA Rules not processed for user `819d41a279e64291acc60de51e1530ae`. Rule list: `[]` (Enabled: `True`). {{(pid=88551) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 19:23:24.648298 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.common.fernet_utils [None req-08dad8f6-3004-4b1c-a9c7-7de8ce931b7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:23:24.654386 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.auth.core [None req-06c8880b-a5a7-4140-95af-206893bc6335 None None] MFA Rules not processed for user `819d41a279e64291acc60de51e1530ae`. Rule list: `[]` (Enabled: `True`). {{(pid=88550) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 19:23:24.655622 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.common.fernet_utils [None req-06c8880b-a5a7-4140-95af-206893bc6335 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:23:24.656927 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: [pid: 88551|app: 0|req: 576/1165] 10.222.0.26 () {58 vars in 958 bytes} [Wed Aug 17 19:23:24 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 19:23:24.661388 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08dad8f6-3004-4b1c-a9c7-7de8ce931b7b None None] Authenticating user token {{(pid=88551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:23:24.663627 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: [pid: 88550|app: 0|req: 590/1166] 10.222.0.26 () {58 vars in 958 bytes} [Wed Aug 17 19:23:24 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 17 19:23:24.668105 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06c8880b-a5a7-4140-95af-206893bc6335 None None] Authenticating user token {{(pid=88550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:23:24.671240 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08dad8f6-3004-4b1c-a9c7-7de8ce931b7b None None] Validating token access rules against request {{(pid=88551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:23:24.677089 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92250d7c-902b-4eff-9984-3c21bbb7ac2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '819d41a279e64291acc60de51e1530ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0490e0db9a14e81a7ea7b108a7ad6a0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:23:24.677674 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92250d7c-902b-4eff-9984-3c21bbb7ac2f admin admin] REQUEST_METHOD: `GET` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:23:24.677951 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92250d7c-902b-4eff-9984-3c21bbb7ac2f admin admin] SCRIPT_NAME: `/identity` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:23:24.678189 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06c8880b-a5a7-4140-95af-206893bc6335 None None] Validating token access rules against request {{(pid=88550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:23:24.678315 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92250d7c-902b-4eff-9984-3c21bbb7ac2f admin admin] PATH_INFO: `/v3/domains` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:23:24.678884 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92250d7c-902b-4eff-9984-3c21bbb7ac2f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88551) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 19:23:24.679185 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92250d7c-902b-4eff-9984-3c21bbb7ac2f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:23:24.680773 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92250d7c-902b-4eff-9984-3c21bbb7ac2f admin admin] RBAC: Authorization granted {{(pid=88551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:23:24.683395 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e95d7cb5-3ceb-45fd-a845-6ff87f750db9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '819d41a279e64291acc60de51e1530ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0490e0db9a14e81a7ea7b108a7ad6a0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:23:24.683977 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e95d7cb5-3ceb-45fd-a845-6ff87f750db9 admin admin] REQUEST_METHOD: `GET` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:23:24.684254 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e95d7cb5-3ceb-45fd-a845-6ff87f750db9 admin admin] SCRIPT_NAME: `/identity` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:23:24.684527 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e95d7cb5-3ceb-45fd-a845-6ff87f750db9 admin admin] PATH_INFO: `/v3/domains` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:23:24.685838 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e95d7cb5-3ceb-45fd-a845-6ff87f750db9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88550) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 19:23:24.686141 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e95d7cb5-3ceb-45fd-a845-6ff87f750db9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:23:24.687174 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: WARNING py.warnings [None req-e95d7cb5-3ceb-45fd-a845-6ff87f750db9 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 17 19:23:24.687174 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: warnings.warn(msg) Aug 17 19:23:24.687174 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: Aug 17 19:23:24.688063 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e95d7cb5-3ceb-45fd-a845-6ff87f750db9 admin admin] RBAC: Authorization granted {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:23:24.695835 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: [pid: 88551|app: 0|req: 577/1167] 10.222.0.26 () {58 vars in 1153 bytes} [Wed Aug 17 19:23:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 17 19:23:24.701051 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: [pid: 88550|app: 0|req: 591/1168] 10.222.0.26 () {58 vars in 1153 bytes} [Wed Aug 17 19:23:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 17 19:23:24.703843 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92250d7c-902b-4eff-9984-3c21bbb7ac2f admin admin] Authenticating user token {{(pid=88551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:23:24.708608 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e95d7cb5-3ceb-45fd-a845-6ff87f750db9 admin admin] Authenticating user token {{(pid=88550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:23:24.714253 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92250d7c-902b-4eff-9984-3c21bbb7ac2f admin admin] Validating token access rules against request {{(pid=88551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:23:24.719057 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e95d7cb5-3ceb-45fd-a845-6ff87f750db9 admin admin] Validating token access rules against request {{(pid=88550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:23:24.719922 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14c16873-b794-4a16-b8e2-7f3057580e5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '819d41a279e64291acc60de51e1530ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0490e0db9a14e81a7ea7b108a7ad6a0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:23:24.720504 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c16873-b794-4a16-b8e2-7f3057580e5b admin admin] REQUEST_METHOD: `POST` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:23:24.720777 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c16873-b794-4a16-b8e2-7f3057580e5b admin admin] SCRIPT_NAME: `/identity` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:23:24.721050 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c16873-b794-4a16-b8e2-7f3057580e5b admin admin] PATH_INFO: `/v3/projects` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:23:24.721837 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14c16873-b794-4a16-b8e2-7f3057580e5b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:23:24.722866 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: WARNING py.warnings [None req-14c16873-b794-4a16-b8e2-7f3057580e5b admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 17 19:23:24.722866 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: warnings.warn(msg) Aug 17 19:23:24.722866 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: Aug 17 19:23:24.723909 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b0bcd20-4060-4ad0-83e6-23b363f9de7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '819d41a279e64291acc60de51e1530ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0490e0db9a14e81a7ea7b108a7ad6a0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:23:24.724096 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14c16873-b794-4a16-b8e2-7f3057580e5b admin admin] RBAC: Authorization granted {{(pid=88551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:23:24.729838 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b0bcd20-4060-4ad0-83e6-23b363f9de7c admin admin] REQUEST_METHOD: `POST` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:23:24.729838 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b0bcd20-4060-4ad0-83e6-23b363f9de7c admin admin] SCRIPT_NAME: `/identity` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:23:24.729838 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b0bcd20-4060-4ad0-83e6-23b363f9de7c admin admin] PATH_INFO: `/v3/projects` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:23:24.729838 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b0bcd20-4060-4ad0-83e6-23b363f9de7c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:23:24.729838 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b0bcd20-4060-4ad0-83e6-23b363f9de7c admin admin] RBAC: Authorization granted {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:23:24.869080 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: [pid: 88551|app: 0|req: 578/1169] 10.222.0.26 () {60 vars in 1153 bytes} [Wed Aug 17 19:23:24 2022] POST /identity/v3/projects => generated 385 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 19:23:24.873499 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14c16873-b794-4a16-b8e2-7f3057580e5b admin admin] Authenticating user token {{(pid=88551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:23:24.880418 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: [pid: 88550|app: 0|req: 592/1170] 10.222.0.26 () {60 vars in 1153 bytes} [Wed Aug 17 19:23:24 2022] POST /identity/v3/projects => generated 377 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 17 19:23:24.884979 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b0bcd20-4060-4ad0-83e6-23b363f9de7c admin admin] Authenticating user token {{(pid=88550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:23:24.936996 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14c16873-b794-4a16-b8e2-7f3057580e5b admin admin] Validating token access rules against request {{(pid=88551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:23:24.953741 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b0bcd20-4060-4ad0-83e6-23b363f9de7c admin admin] Validating token access rules against request {{(pid=88550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:23:24.958587 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce3243c3-83fa-4ca1-9acc-e68337fa957a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '819d41a279e64291acc60de51e1530ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0490e0db9a14e81a7ea7b108a7ad6a0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:23:24.959205 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce3243c3-83fa-4ca1-9acc-e68337fa957a admin admin] REQUEST_METHOD: `POST` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:23:24.959481 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce3243c3-83fa-4ca1-9acc-e68337fa957a admin admin] SCRIPT_NAME: `/identity` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:23:24.959748 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce3243c3-83fa-4ca1-9acc-e68337fa957a admin admin] PATH_INFO: `/v3/users` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:23:24.960367 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce3243c3-83fa-4ca1-9acc-e68337fa957a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:23:24.961434 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: WARNING py.warnings [None req-ce3243c3-83fa-4ca1-9acc-e68337fa957a admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 17 19:23:24.961434 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: warnings.warn(msg) Aug 17 19:23:24.961434 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: Aug 17 19:23:24.962675 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce3243c3-83fa-4ca1-9acc-e68337fa957a admin admin] RBAC: Authorization granted {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:23:25.001596 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3bad0fc-a1f0-4276-b2d0-f99cb94640e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '819d41a279e64291acc60de51e1530ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0490e0db9a14e81a7ea7b108a7ad6a0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:23:25.002236 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3bad0fc-a1f0-4276-b2d0-f99cb94640e9 admin admin] REQUEST_METHOD: `POST` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:23:25.002513 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3bad0fc-a1f0-4276-b2d0-f99cb94640e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:23:25.002817 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3bad0fc-a1f0-4276-b2d0-f99cb94640e9 admin admin] PATH_INFO: `/v3/users` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:23:25.003481 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3bad0fc-a1f0-4276-b2d0-f99cb94640e9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:23:25.005373 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3bad0fc-a1f0-4276-b2d0-f99cb94640e9 admin admin] RBAC: Authorization granted {{(pid=88551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:23:25.061587 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: [pid: 88550|app: 0|req: 593/1171] 10.222.0.26 () {60 vars in 1144 bytes} [Wed Aug 17 19:23:24 2022] POST /identity/v3/users => generated 289 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 19:23:25.065898 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce3243c3-83fa-4ca1-9acc-e68337fa957a admin admin] Authenticating user token {{(pid=88550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:23:25.075992 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce3243c3-83fa-4ca1-9acc-e68337fa957a admin admin] Validating token access rules against request {{(pid=88550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:23:25.080691 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79a92cb1-bb38-4bba-aa08-f406cb4fb324 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '819d41a279e64291acc60de51e1530ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0490e0db9a14e81a7ea7b108a7ad6a0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:23:25.081249 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a92cb1-bb38-4bba-aa08-f406cb4fb324 admin admin] REQUEST_METHOD: `GET` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:23:25.081529 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a92cb1-bb38-4bba-aa08-f406cb4fb324 admin admin] SCRIPT_NAME: `/identity` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:23:25.081799 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a92cb1-bb38-4bba-aa08-f406cb4fb324 admin admin] PATH_INFO: `/v3/roles` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:23:25.082431 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79a92cb1-bb38-4bba-aa08-f406cb4fb324 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:23:25.084091 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79a92cb1-bb38-4bba-aa08-f406cb4fb324 admin admin] RBAC: Authorization granted {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:23:25.094418 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: [pid: 88550|app: 0|req: 594/1172] 10.222.0.26 () {58 vars in 1122 bytes} [Wed Aug 17 19:23:25 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 17 19:23:25.098076 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79a92cb1-bb38-4bba-aa08-f406cb4fb324 admin admin] Authenticating user token {{(pid=88550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:23:25.108424 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79a92cb1-bb38-4bba-aa08-f406cb4fb324 admin admin] Validating token access rules against request {{(pid=88550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:23:25.113257 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47eea7df-e9d4-43a8-9fb3-70401bd70b7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '819d41a279e64291acc60de51e1530ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0490e0db9a14e81a7ea7b108a7ad6a0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:23:25.113831 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47eea7df-e9d4-43a8-9fb3-70401bd70b7a admin admin] REQUEST_METHOD: `GET` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:23:25.114107 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47eea7df-e9d4-43a8-9fb3-70401bd70b7a admin admin] SCRIPT_NAME: `/identity` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:23:25.114378 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47eea7df-e9d4-43a8-9fb3-70401bd70b7a admin admin] PATH_INFO: `/v3/roles` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:23:25.115043 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47eea7df-e9d4-43a8-9fb3-70401bd70b7a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:23:25.116741 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47eea7df-e9d4-43a8-9fb3-70401bd70b7a admin admin] RBAC: Authorization granted {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:23:25.127232 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: [pid: 88550|app: 0|req: 595/1173] 10.222.0.26 () {58 vars in 1122 bytes} [Wed Aug 17 19:23:25 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 17 19:23:25.128645 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: [pid: 88551|app: 0|req: 579/1174] 10.222.0.26 () {60 vars in 1144 bytes} [Wed Aug 17 19:23:24 2022] POST /identity/v3/users => generated 293 bytes in 255 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 17 19:23:25.131386 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47eea7df-e9d4-43a8-9fb3-70401bd70b7a admin admin] Authenticating user token {{(pid=88550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:23:25.132310 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3bad0fc-a1f0-4276-b2d0-f99cb94640e9 admin admin] Authenticating user token {{(pid=88551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:23:25.142183 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47eea7df-e9d4-43a8-9fb3-70401bd70b7a admin admin] Validating token access rules against request {{(pid=88550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:23:25.143058 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3bad0fc-a1f0-4276-b2d0-f99cb94640e9 admin admin] Validating token access rules against request {{(pid=88551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:23:25.146932 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9de8bdec-913b-4823-b750-a1e3c92a78ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '819d41a279e64291acc60de51e1530ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0490e0db9a14e81a7ea7b108a7ad6a0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:23:25.147570 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de8bdec-913b-4823-b750-a1e3c92a78ce admin admin] REQUEST_METHOD: `PUT` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:23:25.147715 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87727093-3b5a-4dcd-9c0a-6278db6ba585 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '819d41a279e64291acc60de51e1530ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0490e0db9a14e81a7ea7b108a7ad6a0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:23:25.147835 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de8bdec-913b-4823-b750-a1e3c92a78ce admin admin] SCRIPT_NAME: `/identity` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:23:25.148117 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de8bdec-913b-4823-b750-a1e3c92a78ce admin admin] PATH_INFO: `/v3/projects/e895dbdff1074a30a40979cbf4731a9d/users/0ccfad6221274bb6ac716060588841d9/roles/748773430faa4030989e1e77b3f361e1` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:23:25.148439 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87727093-3b5a-4dcd-9c0a-6278db6ba585 admin admin] REQUEST_METHOD: `GET` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:23:25.148722 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87727093-3b5a-4dcd-9c0a-6278db6ba585 admin admin] SCRIPT_NAME: `/identity` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:23:25.148995 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87727093-3b5a-4dcd-9c0a-6278db6ba585 admin admin] PATH_INFO: `/v3/roles` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:23:25.149630 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87727093-3b5a-4dcd-9c0a-6278db6ba585 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:23:25.151311 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87727093-3b5a-4dcd-9c0a-6278db6ba585 admin admin] RBAC: Authorization granted {{(pid=88551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:23:25.162932 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: [pid: 88551|app: 0|req: 580/1175] 10.222.0.26 () {58 vars in 1122 bytes} [Wed Aug 17 19:23:25 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 19:23:25.164681 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9de8bdec-913b-4823-b750-a1e3c92a78ce admin admin] RBAC: Authorizing `identity:create_grant(project_id=e895dbdff1074a30a40979cbf4731a9d, user_id=0ccfad6221274bb6ac716060588841d9, role_id=748773430faa4030989e1e77b3f361e1)` {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:23:25.166729 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87727093-3b5a-4dcd-9c0a-6278db6ba585 admin admin] Authenticating user token {{(pid=88551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:23:25.167459 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9de8bdec-913b-4823-b750-a1e3c92a78ce admin admin] RBAC: Authorization granted {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:23:25.176429 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87727093-3b5a-4dcd-9c0a-6278db6ba585 admin admin] Validating token access rules against request {{(pid=88551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:23:25.181075 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-014faafe-bb52-476d-8f10-86a67f46bafc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '819d41a279e64291acc60de51e1530ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0490e0db9a14e81a7ea7b108a7ad6a0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:23:25.181649 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-014faafe-bb52-476d-8f10-86a67f46bafc admin admin] REQUEST_METHOD: `GET` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:23:25.181927 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-014faafe-bb52-476d-8f10-86a67f46bafc admin admin] SCRIPT_NAME: `/identity` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:23:25.182199 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-014faafe-bb52-476d-8f10-86a67f46bafc admin admin] PATH_INFO: `/v3/roles` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:23:25.182946 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-014faafe-bb52-476d-8f10-86a67f46bafc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:23:25.184511 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-014faafe-bb52-476d-8f10-86a67f46bafc admin admin] RBAC: Authorization granted {{(pid=88551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:23:25.195436 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: [pid: 88551|app: 0|req: 581/1176] 10.222.0.26 () {58 vars in 1122 bytes} [Wed Aug 17 19:23:25 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 17 19:23:25.199536 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-014faafe-bb52-476d-8f10-86a67f46bafc admin admin] Authenticating user token {{(pid=88551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:23:25.209510 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-014faafe-bb52-476d-8f10-86a67f46bafc admin admin] Validating token access rules against request {{(pid=88551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:23:25.214389 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce05efa2-d6dd-4fee-ae7c-113cba2c5072 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '819d41a279e64291acc60de51e1530ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0490e0db9a14e81a7ea7b108a7ad6a0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:23:25.215034 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce05efa2-d6dd-4fee-ae7c-113cba2c5072 admin admin] REQUEST_METHOD: `PUT` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:23:25.215312 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce05efa2-d6dd-4fee-ae7c-113cba2c5072 admin admin] SCRIPT_NAME: `/identity` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:23:25.215582 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce05efa2-d6dd-4fee-ae7c-113cba2c5072 admin admin] PATH_INFO: `/v3/projects/d02c2069ce1b432891b6635b4339dfa8/users/77e3bb307c76401f8d2e8bdf0cb15cf2/roles/748773430faa4030989e1e77b3f361e1` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:23:25.231643 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce05efa2-d6dd-4fee-ae7c-113cba2c5072 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d02c2069ce1b432891b6635b4339dfa8, user_id=77e3bb307c76401f8d2e8bdf0cb15cf2, role_id=748773430faa4030989e1e77b3f361e1)` {{(pid=88551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:23:25.232659 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: WARNING py.warnings [None req-ce05efa2-d6dd-4fee-ae7c-113cba2c5072 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 17 19:23:25.232659 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: warnings.warn(msg) Aug 17 19:23:25.232659 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: Aug 17 19:23:25.234681 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce05efa2-d6dd-4fee-ae7c-113cba2c5072 admin admin] RBAC: Authorization granted {{(pid=88551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:23:25.267693 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: [pid: 88550|app: 0|req: 596/1177] 10.222.0.26 () {60 vars in 1483 bytes} [Wed Aug 17 19:23:25 2022] PUT /identity/v3/projects/e895dbdff1074a30a40979cbf4731a9d/users/0ccfad6221274bb6ac716060588841d9/roles/748773430faa4030989e1e77b3f361e1 => generated 0 bytes in 137 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 17 19:23:25.272616 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e634a048-4f05-4482-9f2d-ee67a67c62f1 None None] REQUEST_METHOD: `POST` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:23:25.272906 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e634a048-4f05-4482-9f2d-ee67a67c62f1 None None] SCRIPT_NAME: `/identity` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:23:25.273185 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e634a048-4f05-4482-9f2d-ee67a67c62f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:23:25.291980 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.auth.core [None req-e634a048-4f05-4482-9f2d-ee67a67c62f1 None None] MFA Rules not processed for user `819d41a279e64291acc60de51e1530ae`. Rule list: `[]` (Enabled: `True`). {{(pid=88550) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 19:23:25.293199 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.common.fernet_utils [None req-e634a048-4f05-4482-9f2d-ee67a67c62f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:23:25.324767 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: [pid: 88551|app: 0|req: 582/1178] 10.222.0.26 () {60 vars in 1483 bytes} [Wed Aug 17 19:23:25 2022] PUT /identity/v3/projects/d02c2069ce1b432891b6635b4339dfa8/users/77e3bb307c76401f8d2e8bdf0cb15cf2/roles/748773430faa4030989e1e77b3f361e1 => generated 0 bytes in 126 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 17 19:23:25.330214 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1654544-2250-477b-ad59-c7f62945e9bb None None] REQUEST_METHOD: `POST` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:23:25.330590 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1654544-2250-477b-ad59-c7f62945e9bb None None] SCRIPT_NAME: `/identity` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:23:25.330920 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1654544-2250-477b-ad59-c7f62945e9bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:23:25.338686 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG dbcounter [-] [88551] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=88551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:23:25.343054 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG dbcounter [-] [88550] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=88550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:23:25.351355 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.auth.core [None req-c1654544-2250-477b-ad59-c7f62945e9bb None None] MFA Rules not processed for user `819d41a279e64291acc60de51e1530ae`. Rule list: `[]` (Enabled: `True`). {{(pid=88551) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 19:23:25.356300 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.common.fernet_utils [None req-c1654544-2250-477b-ad59-c7f62945e9bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:23:25.356422 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: [pid: 88550|app: 0|req: 597/1179] 10.222.0.26 () {58 vars in 958 bytes} [Wed Aug 17 19:23:25 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 17 19:23:25.367389 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e634a048-4f05-4482-9f2d-ee67a67c62f1 None None] Authenticating user token {{(pid=88550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:23:25.368856 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.common.fernet_utils [None req-e634a048-4f05-4482-9f2d-ee67a67c62f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:23:25.417517 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: [pid: 88551|app: 0|req: 583/1180] 10.222.0.26 () {58 vars in 958 bytes} [Wed Aug 17 19:23:25 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 17 19:23:25.426977 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e634a048-4f05-4482-9f2d-ee67a67c62f1 None None] Validating token access rules against request {{(pid=88550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:23:25.427426 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1654544-2250-477b-ad59-c7f62945e9bb None None] Authenticating user token {{(pid=88551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:23:25.475769 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f8fdcd3-6b38-46bc-85cf-a9ce5a69cdb7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8240f6e0b65545708f07e040c09e1490', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4bbf6c5abd684d899d09a08b0847d81c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:23:25.476377 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f8fdcd3-6b38-46bc-85cf-a9ce5a69cdb7 service neutron] REQUEST_METHOD: `GET` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:23:25.476655 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f8fdcd3-6b38-46bc-85cf-a9ce5a69cdb7 service neutron] SCRIPT_NAME: `/identity` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:23:25.476924 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f8fdcd3-6b38-46bc-85cf-a9ce5a69cdb7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:23:25.483030 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1654544-2250-477b-ad59-c7f62945e9bb None None] Validating token access rules against request {{(pid=88551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:23:25.486724 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf408cf9-8eaa-4276-a0e3-20fb4fe60105 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8240f6e0b65545708f07e040c09e1490', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4bbf6c5abd684d899d09a08b0847d81c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:23:25.486889 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f8fdcd3-6b38-46bc-85cf-a9ce5a69cdb7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:23:25.487317 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf408cf9-8eaa-4276-a0e3-20fb4fe60105 service neutron] REQUEST_METHOD: `GET` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:23:25.487594 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf408cf9-8eaa-4276-a0e3-20fb4fe60105 service neutron] SCRIPT_NAME: `/identity` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:23:25.487864 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf408cf9-8eaa-4276-a0e3-20fb4fe60105 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:23:25.488232 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f8fdcd3-6b38-46bc-85cf-a9ce5a69cdb7 service neutron] RBAC: Authorization granted {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:23:25.497741 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf408cf9-8eaa-4276-a0e3-20fb4fe60105 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:23:25.499206 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf408cf9-8eaa-4276-a0e3-20fb4fe60105 service neutron] RBAC: Authorization granted {{(pid=88551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:23:25.499682 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: [pid: 88550|app: 0|req: 598/1181] 10.222.0.26 () {60 vars in 1365 bytes} [Wed Aug 17 19:23:25 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 133 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 19:23:25.508771 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: [pid: 88551|app: 0|req: 584/1182] 10.222.0.26 () {60 vars in 1365 bytes} [Wed Aug 17 19:23:25 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 17 19:23:34.398523 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3fb3b99-443a-4086-91ca-2f2683bcc1ff None None] REQUEST_METHOD: `POST` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:23:34.398523 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3fb3b99-443a-4086-91ca-2f2683bcc1ff None None] SCRIPT_NAME: `/identity` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:23:34.403109 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3fb3b99-443a-4086-91ca-2f2683bcc1ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:23:34.411445 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af3447b-5b40-4c18-8ddb-7b795f56edf0 None None] REQUEST_METHOD: `POST` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:23:34.412031 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af3447b-5b40-4c18-8ddb-7b795f56edf0 None None] SCRIPT_NAME: `/identity` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:23:34.412031 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af3447b-5b40-4c18-8ddb-7b795f56edf0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:23:34.430696 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.auth.core [None req-f3fb3b99-443a-4086-91ca-2f2683bcc1ff None None] MFA Rules not processed for user `77e3bb307c76401f8d2e8bdf0cb15cf2`. Rule list: `[]` (Enabled: `True`). {{(pid=88550) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 19:23:34.431945 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.common.fernet_utils [None req-f3fb3b99-443a-4086-91ca-2f2683bcc1ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:23:34.443768 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.auth.core [None req-5af3447b-5b40-4c18-8ddb-7b795f56edf0 None None] MFA Rules not processed for user `0ccfad6221274bb6ac716060588841d9`. Rule list: `[]` (Enabled: `True`). {{(pid=88551) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 19:23:34.444962 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.common.fernet_utils [None req-5af3447b-5b40-4c18-8ddb-7b795f56edf0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:23:34.522212 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: [pid: 88550|app: 0|req: 599/1183] 10.222.0.26 () {58 vars in 958 bytes} [Wed Aug 17 19:23:34 2022] POST /identity/v3/auth/tokens => generated 2822 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 19:23:34.526642 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3fb3b99-443a-4086-91ca-2f2683bcc1ff None None] Authenticating user token {{(pid=88550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:23:34.539252 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3fb3b99-443a-4086-91ca-2f2683bcc1ff None None] Validating token access rules against request {{(pid=88550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:23:34.541896 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: [pid: 88551|app: 0|req: 585/1184] 10.222.0.26 () {58 vars in 958 bytes} [Wed Aug 17 19:23:34 2022] POST /identity/v3/auth/tokens => generated 2814 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 19:23:34.546240 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccd3212e-a4e6-43d7-8dc3-11c36df69c7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '819d41a279e64291acc60de51e1530ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0490e0db9a14e81a7ea7b108a7ad6a0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:23:34.546415 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5af3447b-5b40-4c18-8ddb-7b795f56edf0 None None] Authenticating user token {{(pid=88551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:23:34.547036 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd3212e-a4e6-43d7-8dc3-11c36df69c7d admin admin] REQUEST_METHOD: `POST` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:23:34.547320 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd3212e-a4e6-43d7-8dc3-11c36df69c7d admin admin] SCRIPT_NAME: `/identity` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:23:34.547595 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd3212e-a4e6-43d7-8dc3-11c36df69c7d admin admin] PATH_INFO: `/v3/projects` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:23:34.548239 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccd3212e-a4e6-43d7-8dc3-11c36df69c7d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:23:34.550191 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccd3212e-a4e6-43d7-8dc3-11c36df69c7d admin admin] RBAC: Authorization granted {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:23:34.557563 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5af3447b-5b40-4c18-8ddb-7b795f56edf0 None None] Validating token access rules against request {{(pid=88551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:23:34.563726 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78acdd4a-ebce-4d5d-90c9-333041031f11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '819d41a279e64291acc60de51e1530ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0490e0db9a14e81a7ea7b108a7ad6a0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:23:34.565064 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78acdd4a-ebce-4d5d-90c9-333041031f11 admin admin] REQUEST_METHOD: `POST` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:23:34.565846 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78acdd4a-ebce-4d5d-90c9-333041031f11 admin admin] SCRIPT_NAME: `/identity` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:23:34.566728 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78acdd4a-ebce-4d5d-90c9-333041031f11 admin admin] PATH_INFO: `/v3/projects` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:23:34.568926 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78acdd4a-ebce-4d5d-90c9-333041031f11 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:23:34.571080 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78acdd4a-ebce-4d5d-90c9-333041031f11 admin admin] RBAC: Authorization granted {{(pid=88551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:23:34.676571 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: [pid: 88550|app: 0|req: 600/1185] 10.222.0.26 () {60 vars in 1153 bytes} [Wed Aug 17 19:23:34 2022] POST /identity/v3/projects => generated 383 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 17 19:23:34.680196 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccd3212e-a4e6-43d7-8dc3-11c36df69c7d admin admin] Authenticating user token {{(pid=88550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:23:34.716956 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: [pid: 88551|app: 0|req: 586/1186] 10.222.0.26 () {60 vars in 1153 bytes} [Wed Aug 17 19:23:34 2022] POST /identity/v3/projects => generated 377 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 17 19:23:34.720875 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78acdd4a-ebce-4d5d-90c9-333041031f11 admin admin] Authenticating user token {{(pid=88551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:23:34.746248 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG dbcounter [-] [88551] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:23:34.758749 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG dbcounter [-] [88550] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:23:34.820830 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78acdd4a-ebce-4d5d-90c9-333041031f11 admin admin] Validating token access rules against request {{(pid=88551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:23:34.827350 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3d36ba4-44b3-49f2-aa09-2483ae32e3d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '819d41a279e64291acc60de51e1530ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0490e0db9a14e81a7ea7b108a7ad6a0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:23:34.827802 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d36ba4-44b3-49f2-aa09-2483ae32e3d6 admin admin] REQUEST_METHOD: `POST` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:23:34.828187 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d36ba4-44b3-49f2-aa09-2483ae32e3d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:23:34.828584 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d36ba4-44b3-49f2-aa09-2483ae32e3d6 admin admin] PATH_INFO: `/v3/users` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:23:34.829486 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3d36ba4-44b3-49f2-aa09-2483ae32e3d6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:23:34.831823 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3d36ba4-44b3-49f2-aa09-2483ae32e3d6 admin admin] RBAC: Authorization granted {{(pid=88551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:23:34.843550 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccd3212e-a4e6-43d7-8dc3-11c36df69c7d admin admin] Validating token access rules against request {{(pid=88550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:23:34.849400 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdd82fd1-95d7-42f7-8d46-1702178a25f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '819d41a279e64291acc60de51e1530ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0490e0db9a14e81a7ea7b108a7ad6a0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:23:34.850032 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd82fd1-95d7-42f7-8d46-1702178a25f6 admin admin] REQUEST_METHOD: `POST` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:23:34.850353 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd82fd1-95d7-42f7-8d46-1702178a25f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:23:34.850696 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd82fd1-95d7-42f7-8d46-1702178a25f6 admin admin] PATH_INFO: `/v3/users` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:23:34.851410 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdd82fd1-95d7-42f7-8d46-1702178a25f6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:23:34.853420 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdd82fd1-95d7-42f7-8d46-1702178a25f6 admin admin] RBAC: Authorization granted {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:23:35.013101 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: [pid: 88550|app: 0|req: 601/1187] 10.222.0.26 () {60 vars in 1144 bytes} [Wed Aug 17 19:23:34 2022] POST /identity/v3/users => generated 298 bytes in 333 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 17 19:23:35.022470 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdd82fd1-95d7-42f7-8d46-1702178a25f6 admin admin] Authenticating user token {{(pid=88550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:23:35.026315 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: [pid: 88551|app: 0|req: 587/1188] 10.222.0.26 () {60 vars in 1144 bytes} [Wed Aug 17 19:23:34 2022] POST /identity/v3/users => generated 295 bytes in 305 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 17 19:23:35.036268 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3d36ba4-44b3-49f2-aa09-2483ae32e3d6 admin admin] Authenticating user token {{(pid=88551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:23:35.037968 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdd82fd1-95d7-42f7-8d46-1702178a25f6 admin admin] Validating token access rules against request {{(pid=88550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:23:35.042967 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84f5da04-a5cd-4ca6-85d8-5aac21205062 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '819d41a279e64291acc60de51e1530ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0490e0db9a14e81a7ea7b108a7ad6a0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:23:35.043581 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f5da04-a5cd-4ca6-85d8-5aac21205062 admin admin] REQUEST_METHOD: `GET` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:23:35.043866 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f5da04-a5cd-4ca6-85d8-5aac21205062 admin admin] SCRIPT_NAME: `/identity` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:23:35.044725 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f5da04-a5cd-4ca6-85d8-5aac21205062 admin admin] PATH_INFO: `/v3/roles` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:23:35.045376 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84f5da04-a5cd-4ca6-85d8-5aac21205062 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:23:35.047073 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84f5da04-a5cd-4ca6-85d8-5aac21205062 admin admin] RBAC: Authorization granted {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:23:35.056114 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3d36ba4-44b3-49f2-aa09-2483ae32e3d6 admin admin] Validating token access rules against request {{(pid=88551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:23:35.061725 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18e44c48-e19d-4a45-a5dc-5cc39ee56dab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '819d41a279e64291acc60de51e1530ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0490e0db9a14e81a7ea7b108a7ad6a0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:23:35.062695 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e44c48-e19d-4a45-a5dc-5cc39ee56dab admin admin] REQUEST_METHOD: `GET` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:23:35.063038 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e44c48-e19d-4a45-a5dc-5cc39ee56dab admin admin] SCRIPT_NAME: `/identity` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:23:35.063753 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: [pid: 88550|app: 0|req: 602/1189] 10.222.0.26 () {58 vars in 1122 bytes} [Wed Aug 17 19:23:35 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 19:23:35.064411 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e44c48-e19d-4a45-a5dc-5cc39ee56dab admin admin] PATH_INFO: `/v3/roles` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:23:35.065101 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18e44c48-e19d-4a45-a5dc-5cc39ee56dab admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:23:35.067080 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18e44c48-e19d-4a45-a5dc-5cc39ee56dab admin admin] RBAC: Authorization granted {{(pid=88551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:23:35.068248 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84f5da04-a5cd-4ca6-85d8-5aac21205062 admin admin] Authenticating user token {{(pid=88550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:23:35.081929 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: [pid: 88551|app: 0|req: 588/1190] 10.222.0.26 () {58 vars in 1122 bytes} [Wed Aug 17 19:23:35 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 19:23:35.082863 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18e44c48-e19d-4a45-a5dc-5cc39ee56dab admin admin] Authenticating user token {{(pid=88551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:23:35.091478 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84f5da04-a5cd-4ca6-85d8-5aac21205062 admin admin] Validating token access rules against request {{(pid=88550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:23:35.095717 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18e44c48-e19d-4a45-a5dc-5cc39ee56dab admin admin] Validating token access rules against request {{(pid=88551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:23:35.100320 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fe487b7-2393-4bef-ad5d-90a78a0ad38d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '819d41a279e64291acc60de51e1530ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0490e0db9a14e81a7ea7b108a7ad6a0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:23:35.100984 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe487b7-2393-4bef-ad5d-90a78a0ad38d admin admin] REQUEST_METHOD: `PUT` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:23:35.101499 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe487b7-2393-4bef-ad5d-90a78a0ad38d admin admin] SCRIPT_NAME: `/identity` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:23:35.101781 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe487b7-2393-4bef-ad5d-90a78a0ad38d admin admin] PATH_INFO: `/v3/projects/4af36deed39644a8bd7b8c4d77c7d445/users/1ee8d76f9e454235bfe30aedacb11063/roles/204f62ae18174b60a2e3f5d4f28ea326` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:23:35.103593 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb44705d-3c24-4fee-9221-fbd03800ba8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '819d41a279e64291acc60de51e1530ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0490e0db9a14e81a7ea7b108a7ad6a0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:23:35.105440 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb44705d-3c24-4fee-9221-fbd03800ba8e admin admin] REQUEST_METHOD: `PUT` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:23:35.105847 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb44705d-3c24-4fee-9221-fbd03800ba8e admin admin] SCRIPT_NAME: `/identity` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:23:35.106228 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb44705d-3c24-4fee-9221-fbd03800ba8e admin admin] PATH_INFO: `/v3/projects/8d36522364df449897dae7d1b3893144/users/c52a5447bdbf42eca846b8571a5b823c/roles/204f62ae18174b60a2e3f5d4f28ea326` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:23:35.127847 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fe487b7-2393-4bef-ad5d-90a78a0ad38d admin admin] RBAC: Authorizing `identity:create_grant(project_id=4af36deed39644a8bd7b8c4d77c7d445, user_id=1ee8d76f9e454235bfe30aedacb11063, role_id=204f62ae18174b60a2e3f5d4f28ea326)` {{(pid=88551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:23:35.128199 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb44705d-3c24-4fee-9221-fbd03800ba8e admin admin] RBAC: Authorizing `identity:create_grant(project_id=8d36522364df449897dae7d1b3893144, user_id=c52a5447bdbf42eca846b8571a5b823c, role_id=204f62ae18174b60a2e3f5d4f28ea326)` {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:23:35.130984 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb44705d-3c24-4fee-9221-fbd03800ba8e admin admin] RBAC: Authorization granted {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:23:35.133399 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fe487b7-2393-4bef-ad5d-90a78a0ad38d admin admin] RBAC: Authorization granted {{(pid=88551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:23:35.257100 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: [pid: 88550|app: 0|req: 603/1191] 10.222.0.26 () {60 vars in 1483 bytes} [Wed Aug 17 19:23:35 2022] PUT /identity/v3/projects/8d36522364df449897dae7d1b3893144/users/c52a5447bdbf42eca846b8571a5b823c/roles/204f62ae18174b60a2e3f5d4f28ea326 => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 19:23:35.261046 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb44705d-3c24-4fee-9221-fbd03800ba8e admin admin] Authenticating user token {{(pid=88550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:23:35.297785 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: [pid: 88551|app: 0|req: 589/1192] 10.222.0.26 () {60 vars in 1483 bytes} [Wed Aug 17 19:23:35 2022] PUT /identity/v3/projects/4af36deed39644a8bd7b8c4d77c7d445/users/1ee8d76f9e454235bfe30aedacb11063/roles/204f62ae18174b60a2e3f5d4f28ea326 => generated 0 bytes in 215 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 19:23:35.304841 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fe487b7-2393-4bef-ad5d-90a78a0ad38d admin admin] Authenticating user token {{(pid=88551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:23:35.337748 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb44705d-3c24-4fee-9221-fbd03800ba8e admin admin] Validating token access rules against request {{(pid=88550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:23:35.395266 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fe487b7-2393-4bef-ad5d-90a78a0ad38d admin admin] Validating token access rules against request {{(pid=88551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:23:35.401383 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dce88c0c-9c6f-4e24-9148-55f71584b601 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '819d41a279e64291acc60de51e1530ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0490e0db9a14e81a7ea7b108a7ad6a0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:23:35.402165 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce88c0c-9c6f-4e24-9148-55f71584b601 admin admin] REQUEST_METHOD: `GET` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:23:35.402446 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce88c0c-9c6f-4e24-9148-55f71584b601 admin admin] SCRIPT_NAME: `/identity` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:23:35.402901 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce88c0c-9c6f-4e24-9148-55f71584b601 admin admin] PATH_INFO: `/v3/roles` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:23:35.403590 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dce88c0c-9c6f-4e24-9148-55f71584b601 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:23:35.405218 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dce88c0c-9c6f-4e24-9148-55f71584b601 admin admin] RBAC: Authorization granted {{(pid=88551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:23:35.417667 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: [pid: 88551|app: 0|req: 590/1193] 10.222.0.26 () {58 vars in 1122 bytes} [Wed Aug 17 19:23:35 2022] GET /identity/v3/roles => generated 1420 bytes in 115 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 19:23:35.421529 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dce88c0c-9c6f-4e24-9148-55f71584b601 admin admin] Authenticating user token {{(pid=88551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:23:35.425115 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd75619e-8775-4caa-8dba-786c1fabf64b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '819d41a279e64291acc60de51e1530ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0490e0db9a14e81a7ea7b108a7ad6a0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:23:35.425859 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd75619e-8775-4caa-8dba-786c1fabf64b admin admin] REQUEST_METHOD: `GET` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:23:35.426214 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd75619e-8775-4caa-8dba-786c1fabf64b admin admin] SCRIPT_NAME: `/identity` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:23:35.426657 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd75619e-8775-4caa-8dba-786c1fabf64b admin admin] PATH_INFO: `/v3/roles` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:23:35.427393 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd75619e-8775-4caa-8dba-786c1fabf64b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:23:35.429224 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd75619e-8775-4caa-8dba-786c1fabf64b admin admin] RBAC: Authorization granted {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:23:35.435807 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dce88c0c-9c6f-4e24-9148-55f71584b601 admin admin] Validating token access rules against request {{(pid=88551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:23:35.442113 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: [pid: 88550|app: 0|req: 604/1194] 10.222.0.26 () {58 vars in 1122 bytes} [Wed Aug 17 19:23:35 2022] GET /identity/v3/roles => generated 1420 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 17 19:23:35.443337 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-596ea065-a80e-4a5a-9d85-188b97b60cbb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '819d41a279e64291acc60de51e1530ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0490e0db9a14e81a7ea7b108a7ad6a0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:23:35.444014 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-596ea065-a80e-4a5a-9d85-188b97b60cbb admin admin] REQUEST_METHOD: `PUT` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:23:35.444296 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-596ea065-a80e-4a5a-9d85-188b97b60cbb admin admin] SCRIPT_NAME: `/identity` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:23:35.444571 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-596ea065-a80e-4a5a-9d85-188b97b60cbb admin admin] PATH_INFO: `/v3/projects/4af36deed39644a8bd7b8c4d77c7d445/users/1ee8d76f9e454235bfe30aedacb11063/roles/204f62ae18174b60a2e3f5d4f28ea326` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:23:35.446049 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd75619e-8775-4caa-8dba-786c1fabf64b admin admin] Authenticating user token {{(pid=88550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:23:35.448631 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-596ea065-a80e-4a5a-9d85-188b97b60cbb admin admin] RBAC: Authorizing `identity:create_grant(project_id=4af36deed39644a8bd7b8c4d77c7d445, user_id=1ee8d76f9e454235bfe30aedacb11063, role_id=204f62ae18174b60a2e3f5d4f28ea326)` {{(pid=88551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:23:35.452160 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-596ea065-a80e-4a5a-9d85-188b97b60cbb admin admin] RBAC: Authorization granted {{(pid=88551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:23:35.462204 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd75619e-8775-4caa-8dba-786c1fabf64b admin admin] Validating token access rules against request {{(pid=88550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:23:35.463894 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: [pid: 88551|app: 0|req: 591/1195] 10.222.0.26 () {60 vars in 1483 bytes} [Wed Aug 17 19:23:35 2022] PUT /identity/v3/projects/4af36deed39644a8bd7b8c4d77c7d445/users/1ee8d76f9e454235bfe30aedacb11063/roles/204f62ae18174b60a2e3f5d4f28ea326 => generated 0 bytes in 43 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 17 19:23:35.485057 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG dbcounter [-] [88550] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=88550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:23:35.527497 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8ccdaf5-2209-404e-94f5-022b42659c76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '819d41a279e64291acc60de51e1530ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0490e0db9a14e81a7ea7b108a7ad6a0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:23:35.528148 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ccdaf5-2209-404e-94f5-022b42659c76 admin admin] REQUEST_METHOD: `PUT` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:23:35.528425 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ccdaf5-2209-404e-94f5-022b42659c76 admin admin] SCRIPT_NAME: `/identity` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:23:35.528756 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ccdaf5-2209-404e-94f5-022b42659c76 admin admin] PATH_INFO: `/v3/projects/8d36522364df449897dae7d1b3893144/users/c52a5447bdbf42eca846b8571a5b823c/roles/204f62ae18174b60a2e3f5d4f28ea326` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:23:35.530709 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8ccdaf5-2209-404e-94f5-022b42659c76 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8d36522364df449897dae7d1b3893144, user_id=c52a5447bdbf42eca846b8571a5b823c, role_id=204f62ae18174b60a2e3f5d4f28ea326)` {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:23:35.533362 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8ccdaf5-2209-404e-94f5-022b42659c76 admin admin] RBAC: Authorization granted {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:23:35.543841 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: [pid: 88550|app: 0|req: 605/1196] 10.222.0.26 () {60 vars in 1483 bytes} [Wed Aug 17 19:23:35 2022] PUT /identity/v3/projects/8d36522364df449897dae7d1b3893144/users/c52a5447bdbf42eca846b8571a5b823c/roles/204f62ae18174b60a2e3f5d4f28ea326 => generated 0 bytes in 98 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 17 19:23:42.531189 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a4b1644-0ec2-463f-9b40-587ad6062bae None None] REQUEST_METHOD: `POST` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:23:42.531711 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a4b1644-0ec2-463f-9b40-587ad6062bae None None] SCRIPT_NAME: `/identity` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:23:42.531826 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a4b1644-0ec2-463f-9b40-587ad6062bae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:23:42.562469 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.auth.core [None req-1a4b1644-0ec2-463f-9b40-587ad6062bae None None] MFA Rules not processed for user `c52a5447bdbf42eca846b8571a5b823c`. Rule list: `[]` (Enabled: `True`). {{(pid=88551) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 19:23:42.563798 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.common.fernet_utils [None req-1a4b1644-0ec2-463f-9b40-587ad6062bae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:23:42.613662 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG dbcounter [-] [88551] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=88551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:23:42.644960 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: [pid: 88551|app: 0|req: 592/1197] 10.222.0.26 () {58 vars in 958 bytes} [Wed Aug 17 19:23:42 2022] POST /identity/v3/auth/tokens => generated 2887 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 19:23:42.659882 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8ccdaf5-2209-404e-94f5-022b42659c76 admin admin] Authenticating user token {{(pid=88550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:23:42.661881 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.common.fernet_utils [None req-d8ccdaf5-2209-404e-94f5-022b42659c76 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:23:42.743974 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8ccdaf5-2209-404e-94f5-022b42659c76 admin admin] Validating token access rules against request {{(pid=88550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:23:42.748855 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ce769bd-8b0d-4378-a519-a69cd6022cf9 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f32f6111c1c4f1f86c2185bde99a368', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4bbf6c5abd684d899d09a08b0847d81c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:23:42.749641 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce769bd-8b0d-4378-a519-a69cd6022cf9 service glance] REQUEST_METHOD: `GET` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:23:42.750113 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce769bd-8b0d-4378-a519-a69cd6022cf9 service glance] SCRIPT_NAME: `/identity` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:23:42.750486 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce769bd-8b0d-4378-a519-a69cd6022cf9 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:23:42.839517 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ce769bd-8b0d-4378-a519-a69cd6022cf9 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:23:42.842078 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ce769bd-8b0d-4378-a519-a69cd6022cf9 service glance] RBAC: Authorization granted {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:23:42.856169 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: [pid: 88550|app: 0|req: 606/1198] 10.222.0.26 () {60 vars in 1365 bytes} [Wed Aug 17 19:23:42 2022] GET /identity/v3/auth/tokens => generated 2822 bytes in 197 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 19:23:42.915591 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b515875-013c-4c88-965a-d1ecb8ea4ac7 None None] REQUEST_METHOD: `POST` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:23:42.915943 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b515875-013c-4c88-965a-d1ecb8ea4ac7 None None] SCRIPT_NAME: `/identity` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:23:42.916255 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b515875-013c-4c88-965a-d1ecb8ea4ac7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:23:42.947404 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.auth.core [None req-9b515875-013c-4c88-965a-d1ecb8ea4ac7 None None] MFA Rules not processed for user `1ee8d76f9e454235bfe30aedacb11063`. Rule list: `[]` (Enabled: `True`). {{(pid=88551) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 19:23:42.948570 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.common.fernet_utils [None req-9b515875-013c-4c88-965a-d1ecb8ea4ac7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:23:43.025401 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: [pid: 88551|app: 0|req: 593/1199] 10.222.0.26 () {58 vars in 958 bytes} [Wed Aug 17 19:23:42 2022] POST /identity/v3/auth/tokens => generated 2881 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 19:23:43.049476 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ce769bd-8b0d-4378-a519-a69cd6022cf9 service glance] Authenticating user token {{(pid=88550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:23:43.051083 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.common.fernet_utils [None req-3ce769bd-8b0d-4378-a519-a69cd6022cf9 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:23:43.065069 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ce769bd-8b0d-4378-a519-a69cd6022cf9 service glance] Validating token access rules against request {{(pid=88550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:23:43.070682 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-865d8859-cef1-4449-891e-e040f6a0044d service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f32f6111c1c4f1f86c2185bde99a368', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4bbf6c5abd684d899d09a08b0847d81c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:23:43.071424 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-865d8859-cef1-4449-891e-e040f6a0044d service glance] REQUEST_METHOD: `GET` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:23:43.071807 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-865d8859-cef1-4449-891e-e040f6a0044d service glance] SCRIPT_NAME: `/identity` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:23:43.072183 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-865d8859-cef1-4449-891e-e040f6a0044d service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:23:43.142481 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-865d8859-cef1-4449-891e-e040f6a0044d service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:23:43.144519 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-865d8859-cef1-4449-891e-e040f6a0044d service glance] RBAC: Authorization granted {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:23:43.153745 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: [pid: 88550|app: 0|req: 607/1200] 10.222.0.26 () {60 vars in 1365 bytes} [Wed Aug 17 19:23:43 2022] GET /identity/v3/auth/tokens => generated 2814 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 19:23:52.392967 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-124d23a7-dabb-4d99-9dc9-08873c897ca4 None None] REQUEST_METHOD: `POST` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:23:52.393491 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-124d23a7-dabb-4d99-9dc9-08873c897ca4 None None] SCRIPT_NAME: `/identity` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:23:52.393593 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-124d23a7-dabb-4d99-9dc9-08873c897ca4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:23:52.420505 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.auth.core [None req-124d23a7-dabb-4d99-9dc9-08873c897ca4 None None] MFA Rules not processed for user `77e3bb307c76401f8d2e8bdf0cb15cf2`. Rule list: `[]` (Enabled: `True`). {{(pid=88551) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 19:23:52.421769 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.common.fernet_utils [None req-124d23a7-dabb-4d99-9dc9-08873c897ca4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:23:52.429704 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: [pid: 88551|app: 0|req: 594/1201] 10.222.0.26 () {58 vars in 958 bytes} [Wed Aug 17 19:23:52 2022] POST /identity/v3/auth/tokens => generated 2822 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 19:23:52.739774 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf56fbcd-73f2-4444-8911-2278cc075067 None None] REQUEST_METHOD: `GET` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:23:52.742645 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf56fbcd-73f2-4444-8911-2278cc075067 None None] SCRIPT_NAME: `/identity` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:23:52.742645 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf56fbcd-73f2-4444-8911-2278cc075067 None None] PATH_INFO: `/` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:23:52.742645 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: [pid: 88550|app: 0|req: 608/1202] 10.222.0.26 () {54 vars in 962 bytes} [Wed Aug 17 19:23:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 19:23:52.747991 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af5f2c7-655b-4b08-813f-d34e6d21e0db None None] REQUEST_METHOD: `POST` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:23:52.748593 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af5f2c7-655b-4b08-813f-d34e6d21e0db None None] SCRIPT_NAME: `/identity` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:23:52.748992 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af5f2c7-655b-4b08-813f-d34e6d21e0db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:23:52.769625 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.auth.core [None req-6af5f2c7-655b-4b08-813f-d34e6d21e0db None None] MFA Rules not processed for user `9ae23e7a10d54989a25c9f3019184d01`. Rule list: `[]` (Enabled: `True`). {{(pid=88551) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 19:23:52.771256 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.common.fernet_utils [None req-6af5f2c7-655b-4b08-813f-d34e6d21e0db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:23:52.835836 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: [pid: 88551|app: 0|req: 595/1203] 10.222.0.26 () {58 vars in 1059 bytes} [Wed Aug 17 19:23:52 2022] POST /identity/v3/auth/tokens => generated 2863 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 19:23:52.841253 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c7afd05-ce82-49f1-b81f-7fb4cccacb42 None None] REQUEST_METHOD: `GET` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:23:52.841610 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c7afd05-ce82-49f1-b81f-7fb4cccacb42 None None] SCRIPT_NAME: `/identity` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:23:52.841885 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c7afd05-ce82-49f1-b81f-7fb4cccacb42 None None] PATH_INFO: `/` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:23:52.843382 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: [pid: 88550|app: 0|req: 609/1204] 10.222.0.26 () {54 vars in 912 bytes} [Wed Aug 17 19:23:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 19:23:52.848415 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af341b0-2658-4e85-aeb9-f3010d201729 None None] REQUEST_METHOD: `POST` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:23:52.848727 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af341b0-2658-4e85-aeb9-f3010d201729 None None] SCRIPT_NAME: `/identity` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:23:52.849123 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af341b0-2658-4e85-aeb9-f3010d201729 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:23:52.870868 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.auth.core [None req-8af341b0-2658-4e85-aeb9-f3010d201729 None None] MFA Rules not processed for user `9ae23e7a10d54989a25c9f3019184d01`. Rule list: `[]` (Enabled: `True`). {{(pid=88551) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 19:23:52.872782 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.common.fernet_utils [None req-8af341b0-2658-4e85-aeb9-f3010d201729 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:23:52.881784 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: [pid: 88551|app: 0|req: 596/1205] 10.222.0.26 () {58 vars in 1009 bytes} [Wed Aug 17 19:23:52 2022] POST /identity/v3/auth/tokens => generated 2863 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 19:23:52.894729 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c7afd05-ce82-49f1-b81f-7fb4cccacb42 None None] Authenticating user token {{(pid=88550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:23:52.905897 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c7afd05-ce82-49f1-b81f-7fb4cccacb42 None None] Validating token access rules against request {{(pid=88550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:23:52.909863 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de515cc6-f217-4c6b-b9ca-53bec51a35a0 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f32f6111c1c4f1f86c2185bde99a368', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4bbf6c5abd684d899d09a08b0847d81c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:23:52.910599 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de515cc6-f217-4c6b-b9ca-53bec51a35a0 service glance] REQUEST_METHOD: `GET` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:23:52.910894 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de515cc6-f217-4c6b-b9ca-53bec51a35a0 service glance] SCRIPT_NAME: `/identity` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:23:52.911203 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de515cc6-f217-4c6b-b9ca-53bec51a35a0 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:23:52.918071 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG dbcounter [-] [88550] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:23:52.923261 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de515cc6-f217-4c6b-b9ca-53bec51a35a0 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:23:52.924868 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de515cc6-f217-4c6b-b9ca-53bec51a35a0 service glance] RBAC: Authorization granted {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:23:52.936326 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: [pid: 88550|app: 0|req: 610/1206] 10.222.0.26 () {60 vars in 1365 bytes} [Wed Aug 17 19:23:52 2022] GET /identity/v3/auth/tokens => generated 2863 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 19:23:53.283531 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4137f94-5f65-489a-a28a-8194c504223c None None] REQUEST_METHOD: `GET` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:23:53.283895 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4137f94-5f65-489a-a28a-8194c504223c None None] SCRIPT_NAME: `/identity` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:23:53.284238 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4137f94-5f65-489a-a28a-8194c504223c None None] PATH_INFO: `/` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:23:53.285702 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: [pid: 88551|app: 0|req: 597/1207] 10.222.0.26 () {54 vars in 912 bytes} [Wed Aug 17 19:23:53 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 19:23:53.290933 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603b4644-b3f4-46ce-9192-84f1b7ddc513 None None] REQUEST_METHOD: `POST` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:23:53.291219 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603b4644-b3f4-46ce-9192-84f1b7ddc513 None None] SCRIPT_NAME: `/identity` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:23:53.291494 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603b4644-b3f4-46ce-9192-84f1b7ddc513 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:23:53.312018 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.auth.core [None req-603b4644-b3f4-46ce-9192-84f1b7ddc513 None None] MFA Rules not processed for user `8240f6e0b65545708f07e040c09e1490`. Rule list: `[]` (Enabled: `True`). {{(pid=88550) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 19:23:53.313225 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.common.fernet_utils [None req-603b4644-b3f4-46ce-9192-84f1b7ddc513 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:23:53.365389 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: [pid: 88550|app: 0|req: 611/1208] 10.222.0.26 () {58 vars in 1009 bytes} [Wed Aug 17 19:23:53 2022] POST /identity/v3/auth/tokens => generated 2681 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 17 19:23:53.376651 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4137f94-5f65-489a-a28a-8194c504223c None None] Authenticating user token {{(pid=88551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:23:53.388802 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4137f94-5f65-489a-a28a-8194c504223c None None] Validating token access rules against request {{(pid=88551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:23:53.392687 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6298274-8239-405a-bd3b-e734e53a0c8e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8240f6e0b65545708f07e040c09e1490', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4bbf6c5abd684d899d09a08b0847d81c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:23:53.393291 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6298274-8239-405a-bd3b-e734e53a0c8e service neutron] REQUEST_METHOD: `GET` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:23:53.393945 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6298274-8239-405a-bd3b-e734e53a0c8e service neutron] SCRIPT_NAME: `/identity` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:23:53.393945 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6298274-8239-405a-bd3b-e734e53a0c8e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:23:53.401693 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6298274-8239-405a-bd3b-e734e53a0c8e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:23:53.403245 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6298274-8239-405a-bd3b-e734e53a0c8e service neutron] RBAC: Authorization granted {{(pid=88551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:23:53.412258 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: [pid: 88551|app: 0|req: 598/1209] 10.222.0.26 () {60 vars in 1365 bytes} [Wed Aug 17 19:23:53 2022] GET /identity/v3/auth/tokens => generated 2681 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 19:23:54.029426 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c340c91-a0a4-4f4b-9c32-8d0039fabc41 None None] REQUEST_METHOD: `GET` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:23:54.029981 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c340c91-a0a4-4f4b-9c32-8d0039fabc41 None None] SCRIPT_NAME: `/identity` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:23:54.029981 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c340c91-a0a4-4f4b-9c32-8d0039fabc41 None None] PATH_INFO: `/` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:23:54.033230 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: [pid: 88550|app: 0|req: 612/1210] 10.222.0.26 () {54 vars in 962 bytes} [Wed Aug 17 19:23:54 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 19:23:54.038999 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ff1311-50f4-48d2-b13f-6eb6985dee34 None None] REQUEST_METHOD: `POST` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:23:54.039313 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ff1311-50f4-48d2-b13f-6eb6985dee34 None None] SCRIPT_NAME: `/identity` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:23:54.039619 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ff1311-50f4-48d2-b13f-6eb6985dee34 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:23:54.065164 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.auth.core [None req-80ff1311-50f4-48d2-b13f-6eb6985dee34 None None] MFA Rules not processed for user `9ae23e7a10d54989a25c9f3019184d01`. Rule list: `[]` (Enabled: `True`). {{(pid=88551) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 19:23:54.066751 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.common.fernet_utils [None req-80ff1311-50f4-48d2-b13f-6eb6985dee34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:23:54.067082 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af2764e-5624-46b9-95c0-38e7cc4c223f None None] REQUEST_METHOD: `GET` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:23:54.067375 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af2764e-5624-46b9-95c0-38e7cc4c223f None None] SCRIPT_NAME: `/identity` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:23:54.067657 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af2764e-5624-46b9-95c0-38e7cc4c223f None None] PATH_INFO: `/` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:23:54.069141 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: [pid: 88550|app: 0|req: 613/1211] 10.222.0.26 () {54 vars in 961 bytes} [Wed Aug 17 19:23:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 19:23:54.074036 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d819eb0d-ba41-43fc-8aac-fc9acd01b68c None None] REQUEST_METHOD: `POST` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:23:54.074314 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d819eb0d-ba41-43fc-8aac-fc9acd01b68c None None] SCRIPT_NAME: `/identity` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:23:54.074611 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d819eb0d-ba41-43fc-8aac-fc9acd01b68c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:23:54.077745 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: [pid: 88551|app: 0|req: 599/1212] 10.222.0.26 () {58 vars in 1059 bytes} [Wed Aug 17 19:23:54 2022] POST /identity/v3/auth/tokens => generated 2863 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 19:23:54.083465 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a2a549-5bd9-4bb0-acec-6ef8402abe3f None None] REQUEST_METHOD: `GET` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:23:54.083823 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a2a549-5bd9-4bb0-acec-6ef8402abe3f None None] SCRIPT_NAME: `/identity` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:23:54.084163 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a2a549-5bd9-4bb0-acec-6ef8402abe3f None None] PATH_INFO: `/` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:23:54.086135 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: [pid: 88551|app: 0|req: 600/1213] 10.222.0.26 () {54 vars in 912 bytes} [Wed Aug 17 19:23:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 17 19:23:54.092097 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f16cd847-80ff-478a-9413-40a1926074b2 None None] REQUEST_METHOD: `POST` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:23:54.092373 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f16cd847-80ff-478a-9413-40a1926074b2 None None] SCRIPT_NAME: `/identity` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:23:54.092645 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f16cd847-80ff-478a-9413-40a1926074b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:23:54.104489 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.auth.core [None req-d819eb0d-ba41-43fc-8aac-fc9acd01b68c None None] MFA Rules not processed for user `6478a47e33024d1abc99f078dbc30787`. Rule list: `[]` (Enabled: `True`). {{(pid=88550) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 19:23:54.105713 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.common.fernet_utils [None req-d819eb0d-ba41-43fc-8aac-fc9acd01b68c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:23:54.118575 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.auth.core [None req-f16cd847-80ff-478a-9413-40a1926074b2 None None] MFA Rules not processed for user `9ae23e7a10d54989a25c9f3019184d01`. Rule list: `[]` (Enabled: `True`). {{(pid=88551) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 19:23:54.120254 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.common.fernet_utils [None req-f16cd847-80ff-478a-9413-40a1926074b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:23:54.131912 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: [pid: 88551|app: 0|req: 601/1214] 10.222.0.26 () {58 vars in 1009 bytes} [Wed Aug 17 19:23:54 2022] POST /identity/v3/auth/tokens => generated 2863 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 19:23:54.149164 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f16cd847-80ff-478a-9413-40a1926074b2 None None] Authenticating user token {{(pid=88551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:23:54.159141 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f16cd847-80ff-478a-9413-40a1926074b2 None None] Validating token access rules against request {{(pid=88551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:23:54.162706 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d8f253d-07e8-44fc-80b2-1b8c9c28037a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8240f6e0b65545708f07e040c09e1490', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4bbf6c5abd684d899d09a08b0847d81c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:23:54.163332 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d8f253d-07e8-44fc-80b2-1b8c9c28037a service neutron] REQUEST_METHOD: `GET` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:23:54.163609 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d8f253d-07e8-44fc-80b2-1b8c9c28037a service neutron] SCRIPT_NAME: `/identity` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:23:54.163878 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d8f253d-07e8-44fc-80b2-1b8c9c28037a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:23:54.174808 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d8f253d-07e8-44fc-80b2-1b8c9c28037a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:23:54.176455 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d8f253d-07e8-44fc-80b2-1b8c9c28037a service neutron] RBAC: Authorization granted {{(pid=88551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:23:54.188184 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: [pid: 88551|app: 0|req: 602/1215] 10.222.0.26 () {60 vars in 1365 bytes} [Wed Aug 17 19:23:54 2022] GET /identity/v3/auth/tokens => generated 2863 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 19:23:54.193519 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: [pid: 88550|app: 0|req: 614/1216] 10.222.0.26 () {58 vars in 1058 bytes} [Wed Aug 17 19:23:54 2022] POST /identity/v3/auth/tokens => generated 2868 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 17 19:23:54.203708 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d8f253d-07e8-44fc-80b2-1b8c9c28037a service neutron] Authenticating user token {{(pid=88551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:23:54.210569 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG dbcounter [-] [88551] Writing DB stats keystone:SELECT=100 {{(pid=88551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:23:54.215192 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d8f253d-07e8-44fc-80b2-1b8c9c28037a service neutron] Validating token access rules against request {{(pid=88551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:23:54.224516 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-062478b2-7ca3-4963-88e2-246eb0d9a56c service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6478a47e33024d1abc99f078dbc30787', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4bbf6c5abd684d899d09a08b0847d81c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:23:54.224516 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-062478b2-7ca3-4963-88e2-246eb0d9a56c service placement] REQUEST_METHOD: `GET` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:23:54.224516 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-062478b2-7ca3-4963-88e2-246eb0d9a56c service placement] SCRIPT_NAME: `/identity` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:23:54.224516 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-062478b2-7ca3-4963-88e2-246eb0d9a56c service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:23:54.224920 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.common.fernet_utils [None req-062478b2-7ca3-4963-88e2-246eb0d9a56c service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:23:54.236849 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-062478b2-7ca3-4963-88e2-246eb0d9a56c service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=88551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:23:54.238849 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-062478b2-7ca3-4963-88e2-246eb0d9a56c service placement] RBAC: Authorization granted {{(pid=88551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:23:54.254353 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: [pid: 88551|app: 0|req: 603/1217] 10.222.0.26 () {60 vars in 1365 bytes} [Wed Aug 17 19:23:54 2022] GET /identity/v3/auth/tokens => generated 2868 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 19:24:04.180272 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG dbcounter [-] [88550] Writing DB stats keystone:SELECT=55 {{(pid=88550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:24:04.256083 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG dbcounter [-] [88551] Writing DB stats keystone:SELECT=4 {{(pid=88551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:24:09.393455 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c076989-6298-4eb8-a4d9-755af1b00125 None None] REQUEST_METHOD: `POST` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:24:09.394071 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c076989-6298-4eb8-a4d9-755af1b00125 None None] SCRIPT_NAME: `/identity` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:24:09.394071 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c076989-6298-4eb8-a4d9-755af1b00125 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:24:09.414594 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.auth.core [None req-8c076989-6298-4eb8-a4d9-755af1b00125 None None] MFA Rules not processed for user `8240f6e0b65545708f07e040c09e1490`. Rule list: `[]` (Enabled: `True`). {{(pid=88550) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 19:24:09.415846 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.common.fernet_utils [None req-8c076989-6298-4eb8-a4d9-755af1b00125 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:24:09.422695 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: [pid: 88550|app: 0|req: 615/1218] 10.222.0.55 () {58 vars in 1015 bytes} [Wed Aug 17 19:24:09 2022] POST /identity/v3/auth/tokens => generated 2681 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 19:24:09.436006 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-062478b2-7ca3-4963-88e2-246eb0d9a56c service placement] Authenticating user token {{(pid=88551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:24:09.446186 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-062478b2-7ca3-4963-88e2-246eb0d9a56c service placement] Validating token access rules against request {{(pid=88551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:24:09.450144 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8722281c-e749-4187-8b81-5e45e867b9d1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8240f6e0b65545708f07e040c09e1490', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4bbf6c5abd684d899d09a08b0847d81c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:24:09.450978 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8722281c-e749-4187-8b81-5e45e867b9d1 service neutron] REQUEST_METHOD: `GET` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:24:09.451450 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8722281c-e749-4187-8b81-5e45e867b9d1 service neutron] SCRIPT_NAME: `/identity` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:24:09.451714 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8722281c-e749-4187-8b81-5e45e867b9d1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:24:09.459818 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8722281c-e749-4187-8b81-5e45e867b9d1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:24:09.464325 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8722281c-e749-4187-8b81-5e45e867b9d1 service neutron] RBAC: Authorization granted {{(pid=88551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:24:09.471738 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: [pid: 88551|app: 0|req: 604/1219] 10.222.0.26 () {60 vars in 1365 bytes} [Wed Aug 17 19:24:09 2022] GET /identity/v3/auth/tokens => generated 2681 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 19:24:11.253584 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-340b9806-e6bd-4f08-ac88-52fca0c8d4ec None None] REQUEST_METHOD: `GET` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:24:11.254131 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-340b9806-e6bd-4f08-ac88-52fca0c8d4ec None None] SCRIPT_NAME: `/identity` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:24:11.254131 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-340b9806-e6bd-4f08-ac88-52fca0c8d4ec None None] PATH_INFO: `/` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:24:11.258595 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: [pid: 88550|app: 0|req: 616/1220] 10.222.0.26 () {54 vars in 921 bytes} [Wed Aug 17 19:24:11 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 19:24:11.283314 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-854e2f64-0d32-4293-bb67-d679937ecee9 None None] REQUEST_METHOD: `POST` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:24:11.283826 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-854e2f64-0d32-4293-bb67-d679937ecee9 None None] SCRIPT_NAME: `/identity` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:24:11.283936 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-854e2f64-0d32-4293-bb67-d679937ecee9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:24:11.308024 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.auth.core [None req-854e2f64-0d32-4293-bb67-d679937ecee9 None None] MFA Rules not processed for user `9ae23e7a10d54989a25c9f3019184d01`. Rule list: `[]` (Enabled: `True`). {{(pid=88551) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 19:24:11.309554 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.common.fernet_utils [None req-854e2f64-0d32-4293-bb67-d679937ecee9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:24:11.323715 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: [pid: 88551|app: 0|req: 605/1221] 10.222.0.26 () {58 vars in 1018 bytes} [Wed Aug 17 19:24:11 2022] POST /identity/v3/auth/tokens => generated 2863 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 19:24:11.337724 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-340b9806-e6bd-4f08-ac88-52fca0c8d4ec None None] Authenticating user token {{(pid=88550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:24:11.353272 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-340b9806-e6bd-4f08-ac88-52fca0c8d4ec None None] Validating token access rules against request {{(pid=88550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:24:11.358793 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-369150a8-bf09-4c6c-bb19-8d3fe7baa4a4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ae23e7a10d54989a25c9f3019184d01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4bbf6c5abd684d899d09a08b0847d81c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:24:11.359402 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-369150a8-bf09-4c6c-bb19-8d3fe7baa4a4 service nova] REQUEST_METHOD: `GET` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:24:11.359680 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-369150a8-bf09-4c6c-bb19-8d3fe7baa4a4 service nova] SCRIPT_NAME: `/identity` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:24:11.359951 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-369150a8-bf09-4c6c-bb19-8d3fe7baa4a4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:24:11.373287 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-369150a8-bf09-4c6c-bb19-8d3fe7baa4a4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:24:11.375550 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-369150a8-bf09-4c6c-bb19-8d3fe7baa4a4 service nova] RBAC: Authorization granted {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:24:11.394686 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: [pid: 88550|app: 0|req: 617/1222] 10.222.0.26 () {60 vars in 1365 bytes} [Wed Aug 17 19:24:11 2022] GET /identity/v3/auth/tokens => generated 2863 bytes in 58 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 19:24:19.915310 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9134a914-0551-4a0b-a81c-e68b0199dfd1 None None] REQUEST_METHOD: `GET` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:24:19.916163 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9134a914-0551-4a0b-a81c-e68b0199dfd1 None None] SCRIPT_NAME: `/identity` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:24:19.916446 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9134a914-0551-4a0b-a81c-e68b0199dfd1 None None] PATH_INFO: `/` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:24:19.917884 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: [pid: 88551|app: 0|req: 606/1223] 10.222.0.26 () {54 vars in 921 bytes} [Wed Aug 17 19:24:19 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 19:24:19.928481 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e40d5a-9de4-499c-b8c9-eaff9eb30b6f None None] REQUEST_METHOD: `POST` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:24:19.929655 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e40d5a-9de4-499c-b8c9-eaff9eb30b6f None None] SCRIPT_NAME: `/identity` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:24:19.929989 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e40d5a-9de4-499c-b8c9-eaff9eb30b6f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:24:19.955095 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.auth.core [None req-65e40d5a-9de4-499c-b8c9-eaff9eb30b6f None None] MFA Rules not processed for user `9ae23e7a10d54989a25c9f3019184d01`. Rule list: `[]` (Enabled: `True`). {{(pid=88550) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 19:24:19.955095 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.common.fernet_utils [None req-65e40d5a-9de4-499c-b8c9-eaff9eb30b6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:24:19.961778 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: [pid: 88550|app: 0|req: 618/1224] 10.222.0.26 () {58 vars in 1018 bytes} [Wed Aug 17 19:24:19 2022] POST /identity/v3/auth/tokens => generated 2863 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 19:24:19.974566 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9134a914-0551-4a0b-a81c-e68b0199dfd1 None None] Authenticating user token {{(pid=88551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:24:19.988783 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9134a914-0551-4a0b-a81c-e68b0199dfd1 None None] Validating token access rules against request {{(pid=88551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:24:19.993981 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b84a09b4-98c4-43ff-ae24-135d33fc9dff service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ae23e7a10d54989a25c9f3019184d01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4bbf6c5abd684d899d09a08b0847d81c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:24:19.994691 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b84a09b4-98c4-43ff-ae24-135d33fc9dff service nova] REQUEST_METHOD: `GET` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:24:19.998804 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b84a09b4-98c4-43ff-ae24-135d33fc9dff service nova] SCRIPT_NAME: `/identity` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:24:19.998804 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b84a09b4-98c4-43ff-ae24-135d33fc9dff service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:24:20.003949 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b84a09b4-98c4-43ff-ae24-135d33fc9dff service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:24:20.005538 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b84a09b4-98c4-43ff-ae24-135d33fc9dff service nova] RBAC: Authorization granted {{(pid=88551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:24:20.016535 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: [pid: 88551|app: 0|req: 607/1225] 10.222.0.26 () {60 vars in 1365 bytes} [Wed Aug 17 19:24:19 2022] GET /identity/v3/auth/tokens => generated 2863 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 19:24:29.945903 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG dbcounter [-] [88550] Writing DB stats keystone:SELECT=12 {{(pid=88550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:24:30.011861 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG dbcounter [-] [88551] Writing DB stats keystone:SELECT=15 {{(pid=88551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:24:40.378271 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65e40d5a-9de4-499c-b8c9-eaff9eb30b6f None None] Authenticating user token {{(pid=88550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:24:40.387546 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65e40d5a-9de4-499c-b8c9-eaff9eb30b6f None None] Validating token access rules against request {{(pid=88550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:24:40.391127 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7af7aafa-5c4b-4f82-90a6-41f60117cde8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8240f6e0b65545708f07e040c09e1490', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4bbf6c5abd684d899d09a08b0847d81c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:24:40.391714 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af7aafa-5c4b-4f82-90a6-41f60117cde8 service neutron] REQUEST_METHOD: `GET` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:24:40.391993 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af7aafa-5c4b-4f82-90a6-41f60117cde8 service neutron] SCRIPT_NAME: `/identity` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:24:40.392266 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af7aafa-5c4b-4f82-90a6-41f60117cde8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:24:40.402032 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7af7aafa-5c4b-4f82-90a6-41f60117cde8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:24:40.403674 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7af7aafa-5c4b-4f82-90a6-41f60117cde8 service neutron] RBAC: Authorization granted {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:24:40.413476 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: [pid: 88550|app: 0|req: 619/1226] 10.222.0.26 () {60 vars in 1365 bytes} [Wed Aug 17 19:24:40 2022] GET /identity/v3/auth/tokens => generated 2887 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 19:24:42.964264 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f022b8a-eab0-47b0-a3f4-3735d3544410 None None] REQUEST_METHOD: `GET` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:24:42.964851 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f022b8a-eab0-47b0-a3f4-3735d3544410 None None] SCRIPT_NAME: `/identity` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:24:42.964851 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f022b8a-eab0-47b0-a3f4-3735d3544410 None None] PATH_INFO: `/` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:24:42.966256 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: [pid: 88551|app: 0|req: 608/1227] 10.222.0.26 () {54 vars in 921 bytes} [Wed Aug 17 19:24:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 19:24:42.972250 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92087fc6-6554-4d71-a2c2-675598488230 None None] REQUEST_METHOD: `POST` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:24:42.972702 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92087fc6-6554-4d71-a2c2-675598488230 None None] SCRIPT_NAME: `/identity` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:24:42.972793 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92087fc6-6554-4d71-a2c2-675598488230 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:24:42.991941 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.auth.core [None req-92087fc6-6554-4d71-a2c2-675598488230 None None] MFA Rules not processed for user `9ae23e7a10d54989a25c9f3019184d01`. Rule list: `[]` (Enabled: `True`). {{(pid=88550) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 19:24:42.993150 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.common.fernet_utils [None req-92087fc6-6554-4d71-a2c2-675598488230 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:24:43.002485 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: [pid: 88550|app: 0|req: 620/1228] 10.222.0.26 () {58 vars in 1018 bytes} [Wed Aug 17 19:24:42 2022] POST /identity/v3/auth/tokens => generated 2863 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 19:24:43.019317 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f022b8a-eab0-47b0-a3f4-3735d3544410 None None] Authenticating user token {{(pid=88551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:24:43.033861 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f022b8a-eab0-47b0-a3f4-3735d3544410 None None] Validating token access rules against request {{(pid=88551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:24:43.040092 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4fe058c-9d78-4450-8663-aa575f9560bb service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ae23e7a10d54989a25c9f3019184d01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4bbf6c5abd684d899d09a08b0847d81c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:24:43.042399 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4fe058c-9d78-4450-8663-aa575f9560bb service nova] REQUEST_METHOD: `GET` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:24:43.042399 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4fe058c-9d78-4450-8663-aa575f9560bb service nova] SCRIPT_NAME: `/identity` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:24:43.042399 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4fe058c-9d78-4450-8663-aa575f9560bb service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:24:43.050179 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4fe058c-9d78-4450-8663-aa575f9560bb service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:24:43.051856 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4fe058c-9d78-4450-8663-aa575f9560bb service nova] RBAC: Authorization granted {{(pid=88551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:24:43.063514 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: [pid: 88551|app: 0|req: 609/1229] 10.222.0.26 () {60 vars in 1365 bytes} [Wed Aug 17 19:24:43 2022] GET /identity/v3/auth/tokens => generated 2863 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 19:24:52.986961 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG dbcounter [-] [88550] Writing DB stats keystone:SELECT=9 {{(pid=88550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:24:53.058345 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG dbcounter [-] [88551] Writing DB stats keystone:SELECT=6 {{(pid=88551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:25:56.104414 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab07da0b-0073-4c45-b422-e72a39bc53e7 None None] REQUEST_METHOD: `POST` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:25:56.104891 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab07da0b-0073-4c45-b422-e72a39bc53e7 None None] SCRIPT_NAME: `/identity` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:25:56.104987 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab07da0b-0073-4c45-b422-e72a39bc53e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:25:56.135149 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.auth.core [None req-ab07da0b-0073-4c45-b422-e72a39bc53e7 None None] MFA Rules not processed for user `0ccfad6221274bb6ac716060588841d9`. Rule list: `[]` (Enabled: `True`). {{(pid=88550) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 19:25:56.136360 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.common.fernet_utils [None req-ab07da0b-0073-4c45-b422-e72a39bc53e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:25:56.162102 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: [pid: 88550|app: 0|req: 621/1230] 10.222.0.26 () {58 vars in 958 bytes} [Wed Aug 17 19:25:56 2022] POST /identity/v3/auth/tokens => generated 2814 bytes in 59 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 19:26:06.160025 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG dbcounter [-] [88550] Writing DB stats keystone:SELECT=15 {{(pid=88550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:26:39.599380 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec422cc9-2125-4160-901e-388055ea4d5f None None] REQUEST_METHOD: `POST` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:26:39.600396 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec422cc9-2125-4160-901e-388055ea4d5f None None] SCRIPT_NAME: `/identity` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:26:39.600470 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec422cc9-2125-4160-901e-388055ea4d5f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:26:39.619411 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.auth.core [None req-ec422cc9-2125-4160-901e-388055ea4d5f None None] MFA Rules not processed for user `0ccfad6221274bb6ac716060588841d9`. Rule list: `[]` (Enabled: `True`). {{(pid=88551) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 19:26:39.620615 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.common.fernet_utils [None req-ec422cc9-2125-4160-901e-388055ea4d5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:26:39.627448 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: [pid: 88551|app: 0|req: 610/1231] 10.222.0.26 () {58 vars in 958 bytes} [Wed Aug 17 19:26:39 2022] POST /identity/v3/auth/tokens => generated 2814 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 19:26:39.949775 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbcfbd0c-1d55-4390-bdab-5af8a795a898 None None] REQUEST_METHOD: `POST` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:26:39.950204 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbcfbd0c-1d55-4390-bdab-5af8a795a898 None None] SCRIPT_NAME: `/identity` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:26:39.950306 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbcfbd0c-1d55-4390-bdab-5af8a795a898 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:26:40.011835 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.auth.core [None req-cbcfbd0c-1d55-4390-bdab-5af8a795a898 None None] MFA Rules not processed for user `8240f6e0b65545708f07e040c09e1490`. Rule list: `[]` (Enabled: `True`). {{(pid=88550) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 19:26:40.013036 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.common.fernet_utils [None req-cbcfbd0c-1d55-4390-bdab-5af8a795a898 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:26:40.046378 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: [pid: 88550|app: 0|req: 622/1232] 10.222.0.26 () {58 vars in 1009 bytes} [Wed Aug 17 19:26:39 2022] POST /identity/v3/auth/tokens => generated 2681 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 19:26:40.057948 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec422cc9-2125-4160-901e-388055ea4d5f None None] Authenticating user token {{(pid=88551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:26:40.067356 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec422cc9-2125-4160-901e-388055ea4d5f None None] Validating token access rules against request {{(pid=88551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:26:40.070974 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dd5d1c7-ef77-4bf6-bc57-40021091dd6a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8240f6e0b65545708f07e040c09e1490', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4bbf6c5abd684d899d09a08b0847d81c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:26:40.071571 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd5d1c7-ef77-4bf6-bc57-40021091dd6a service neutron] REQUEST_METHOD: `GET` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:26:40.072115 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd5d1c7-ef77-4bf6-bc57-40021091dd6a service neutron] SCRIPT_NAME: `/identity` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:26:40.072399 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd5d1c7-ef77-4bf6-bc57-40021091dd6a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:26:40.079436 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dd5d1c7-ef77-4bf6-bc57-40021091dd6a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:26:40.080847 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dd5d1c7-ef77-4bf6-bc57-40021091dd6a service neutron] RBAC: Authorization granted {{(pid=88551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:26:40.089158 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: [pid: 88551|app: 0|req: 611/1233] 10.222.0.26 () {60 vars in 1365 bytes} [Wed Aug 17 19:26:40 2022] GET /identity/v3/auth/tokens => generated 2681 bytes in 32 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 19:26:50.043406 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG dbcounter [-] [88550] Writing DB stats keystone:SELECT=28 {{(pid=88550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:26:50.085844 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG dbcounter [-] [88551] Writing DB stats keystone:SELECT=9 {{(pid=88551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:27:00.116692 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b4cd27a-9019-4542-9b1b-57c44a1d244c None None] REQUEST_METHOD: `POST` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:27:00.117280 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b4cd27a-9019-4542-9b1b-57c44a1d244c None None] SCRIPT_NAME: `/identity` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:27:00.117280 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b4cd27a-9019-4542-9b1b-57c44a1d244c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:27:00.137000 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.auth.core [None req-3b4cd27a-9019-4542-9b1b-57c44a1d244c None None] MFA Rules not processed for user `0ccfad6221274bb6ac716060588841d9`. Rule list: `[]` (Enabled: `True`). {{(pid=88550) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 19:27:00.138214 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.common.fernet_utils [None req-3b4cd27a-9019-4542-9b1b-57c44a1d244c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:27:00.146364 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: [pid: 88550|app: 0|req: 623/1234] 10.222.0.26 () {58 vars in 958 bytes} [Wed Aug 17 19:27:00 2022] POST /identity/v3/auth/tokens => generated 2814 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 19:27:02.279458 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dd5d1c7-ef77-4bf6-bc57-40021091dd6a service neutron] Authenticating user token {{(pid=88551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:27:02.309393 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dd5d1c7-ef77-4bf6-bc57-40021091dd6a service neutron] Validating token access rules against request {{(pid=88551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:27:02.315161 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4240feac-0c41-4b49-b316-6711acdd05f0 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6478a47e33024d1abc99f078dbc30787', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4bbf6c5abd684d899d09a08b0847d81c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:27:02.315756 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4240feac-0c41-4b49-b316-6711acdd05f0 service placement] REQUEST_METHOD: `GET` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:27:02.316036 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4240feac-0c41-4b49-b316-6711acdd05f0 service placement] SCRIPT_NAME: `/identity` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:27:02.316310 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4240feac-0c41-4b49-b316-6711acdd05f0 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:27:02.325714 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4240feac-0c41-4b49-b316-6711acdd05f0 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=88551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:27:02.327343 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4240feac-0c41-4b49-b316-6711acdd05f0 service placement] RBAC: Authorization granted {{(pid=88551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:27:02.337269 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: [pid: 88551|app: 0|req: 612/1235] 10.222.0.26 () {60 vars in 1365 bytes} [Wed Aug 17 19:27:02 2022] GET /identity/v3/auth/tokens => generated 2868 bytes in 58 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 19:27:10.131571 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG dbcounter [-] [88550] Writing DB stats keystone:SELECT=3 {{(pid=88550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:27:12.333080 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG dbcounter [-] [88551] Writing DB stats keystone:SELECT=13 {{(pid=88551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:28:32.373074 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-124b52d0-5b05-4239-8bc5-e2419c2462e6 None None] REQUEST_METHOD: `POST` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:28:32.373633 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-124b52d0-5b05-4239-8bc5-e2419c2462e6 None None] SCRIPT_NAME: `/identity` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:28:32.373633 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-124b52d0-5b05-4239-8bc5-e2419c2462e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:28:32.392675 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.auth.core [None req-124b52d0-5b05-4239-8bc5-e2419c2462e6 None None] MFA Rules not processed for user `0ccfad6221274bb6ac716060588841d9`. Rule list: `[]` (Enabled: `True`). {{(pid=88550) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 19:28:32.393876 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.common.fernet_utils [None req-124b52d0-5b05-4239-8bc5-e2419c2462e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:28:32.401203 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: [pid: 88550|app: 0|req: 624/1236] 10.222.0.26 () {58 vars in 958 bytes} [Wed Aug 17 19:28:32 2022] POST /identity/v3/auth/tokens => generated 2814 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 19:28:42.387349 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG dbcounter [-] [88550] Writing DB stats keystone:SELECT=3 {{(pid=88550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:28:42.836097 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4240feac-0c41-4b49-b316-6711acdd05f0 service placement] Authenticating user token {{(pid=88551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:28:42.845940 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4240feac-0c41-4b49-b316-6711acdd05f0 service placement] Validating token access rules against request {{(pid=88551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:28:42.849536 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03ba5731-b14f-465c-a889-d0e9f5a9ea25 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8240f6e0b65545708f07e040c09e1490', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4bbf6c5abd684d899d09a08b0847d81c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:28:42.850164 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ba5731-b14f-465c-a889-d0e9f5a9ea25 service neutron] REQUEST_METHOD: `GET` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:28:42.850442 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ba5731-b14f-465c-a889-d0e9f5a9ea25 service neutron] SCRIPT_NAME: `/identity` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:28:42.850743 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ba5731-b14f-465c-a889-d0e9f5a9ea25 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:28:42.860198 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03ba5731-b14f-465c-a889-d0e9f5a9ea25 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:28:42.861621 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03ba5731-b14f-465c-a889-d0e9f5a9ea25 service neutron] RBAC: Authorization granted {{(pid=88551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:28:42.873441 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: [pid: 88551|app: 0|req: 613/1237] 10.222.0.26 () {60 vars in 1396 bytes} [Wed Aug 17 19:28:42 2022] GET /identity/v3/auth/tokens?allow_expired=1 => generated 2814 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 19:28:47.865122 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-124b52d0-5b05-4239-8bc5-e2419c2462e6 None None] Authenticating user token {{(pid=88550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:28:47.879470 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-124b52d0-5b05-4239-8bc5-e2419c2462e6 None None] Validating token access rules against request {{(pid=88550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:28:47.883693 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6adc99d4-8514-40d0-8132-ed87cd067ca6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8240f6e0b65545708f07e040c09e1490', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4bbf6c5abd684d899d09a08b0847d81c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:28:47.884297 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6adc99d4-8514-40d0-8132-ed87cd067ca6 service neutron] REQUEST_METHOD: `GET` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:28:47.884575 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6adc99d4-8514-40d0-8132-ed87cd067ca6 service neutron] SCRIPT_NAME: `/identity` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:28:47.884846 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6adc99d4-8514-40d0-8132-ed87cd067ca6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:28:47.894309 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6adc99d4-8514-40d0-8132-ed87cd067ca6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:28:47.895779 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6adc99d4-8514-40d0-8132-ed87cd067ca6 service neutron] RBAC: Authorization granted {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:28:47.905077 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: [pid: 88550|app: 0|req: 625/1238] 10.222.0.26 () {60 vars in 1365 bytes} [Wed Aug 17 19:28:47 2022] GET /identity/v3/auth/tokens => generated 2881 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 19:28:52.869370 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG dbcounter [-] [88551] Writing DB stats keystone:SELECT=6 {{(pid=88551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:28:57.901056 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG dbcounter [-] [88550] Writing DB stats keystone:SELECT=6 {{(pid=88550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:29:06.993459 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03ba5731-b14f-465c-a889-d0e9f5a9ea25 service neutron] Authenticating user token {{(pid=88551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:29:07.014529 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03ba5731-b14f-465c-a889-d0e9f5a9ea25 service neutron] Validating token access rules against request {{(pid=88551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:29:07.019580 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beebaaee-a142-46ec-a1f4-3bfc3ab972c7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ae23e7a10d54989a25c9f3019184d01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4bbf6c5abd684d899d09a08b0847d81c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:29:07.020104 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beebaaee-a142-46ec-a1f4-3bfc3ab972c7 service nova] REQUEST_METHOD: `GET` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:29:07.020954 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beebaaee-a142-46ec-a1f4-3bfc3ab972c7 service nova] SCRIPT_NAME: `/identity` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:29:07.021345 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beebaaee-a142-46ec-a1f4-3bfc3ab972c7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:29:07.029349 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beebaaee-a142-46ec-a1f4-3bfc3ab972c7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:29:07.030969 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beebaaee-a142-46ec-a1f4-3bfc3ab972c7 service nova] RBAC: Authorization granted {{(pid=88551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:29:07.039829 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: [pid: 88551|app: 0|req: 614/1239] 10.222.0.26 () {60 vars in 1365 bytes} [Wed Aug 17 19:29:06 2022] GET /identity/v3/auth/tokens => generated 2822 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 19:29:07.089462 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6adc99d4-8514-40d0-8132-ed87cd067ca6 service neutron] Authenticating user token {{(pid=88550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:29:07.098139 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6adc99d4-8514-40d0-8132-ed87cd067ca6 service neutron] Validating token access rules against request {{(pid=88550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:29:07.101768 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3b6ee89-c8e6-4c3b-9197-f08b6b06ee08 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8240f6e0b65545708f07e040c09e1490', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4bbf6c5abd684d899d09a08b0847d81c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:29:07.102351 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b6ee89-c8e6-4c3b-9197-f08b6b06ee08 service neutron] REQUEST_METHOD: `GET` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:29:07.102664 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b6ee89-c8e6-4c3b-9197-f08b6b06ee08 service neutron] SCRIPT_NAME: `/identity` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:29:07.102933 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b6ee89-c8e6-4c3b-9197-f08b6b06ee08 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:29:07.112146 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3b6ee89-c8e6-4c3b-9197-f08b6b06ee08 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:29:07.113560 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3b6ee89-c8e6-4c3b-9197-f08b6b06ee08 service neutron] RBAC: Authorization granted {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:29:07.123942 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: [pid: 88550|app: 0|req: 626/1240] 10.222.0.26 () {60 vars in 1365 bytes} [Wed Aug 17 19:29:07 2022] GET /identity/v3/auth/tokens => generated 2863 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 19:29:09.921654 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beebaaee-a142-46ec-a1f4-3bfc3ab972c7 service nova] Authenticating user token {{(pid=88551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:29:09.949239 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beebaaee-a142-46ec-a1f4-3bfc3ab972c7 service nova] Validating token access rules against request {{(pid=88551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:29:09.950761 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49559cf2-1557-41b8-b5f3-e2b28ba6987c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8240f6e0b65545708f07e040c09e1490', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4bbf6c5abd684d899d09a08b0847d81c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:29:09.951486 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49559cf2-1557-41b8-b5f3-e2b28ba6987c service neutron] REQUEST_METHOD: `GET` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:29:09.951882 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49559cf2-1557-41b8-b5f3-e2b28ba6987c service neutron] SCRIPT_NAME: `/identity` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:29:09.952219 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49559cf2-1557-41b8-b5f3-e2b28ba6987c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:29:09.963939 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49559cf2-1557-41b8-b5f3-e2b28ba6987c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:29:09.965661 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49559cf2-1557-41b8-b5f3-e2b28ba6987c service neutron] RBAC: Authorization granted {{(pid=88551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:29:09.978034 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: [pid: 88551|app: 0|req: 615/1241] 10.222.0.26 () {60 vars in 1365 bytes} [Wed Aug 17 19:29:09 2022] GET /identity/v3/auth/tokens => generated 2681 bytes in 56 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 19:29:17.119650 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG dbcounter [-] [88550] Writing DB stats keystone:SELECT=6 {{(pid=88550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:29:19.972106 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG dbcounter [-] [88551] Writing DB stats keystone:SELECT=16 {{(pid=88551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:29:21.528744 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3b6ee89-c8e6-4c3b-9197-f08b6b06ee08 service neutron] Authenticating user token {{(pid=88550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:29:21.538246 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3b6ee89-c8e6-4c3b-9197-f08b6b06ee08 service neutron] Validating token access rules against request {{(pid=88550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:29:21.541969 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4d5be95-da2c-449f-8000-74f6b2064dfd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8240f6e0b65545708f07e040c09e1490', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4bbf6c5abd684d899d09a08b0847d81c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:29:21.542578 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d5be95-da2c-449f-8000-74f6b2064dfd service neutron] REQUEST_METHOD: `GET` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:29:21.542909 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d5be95-da2c-449f-8000-74f6b2064dfd service neutron] SCRIPT_NAME: `/identity` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:29:21.543222 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d5be95-da2c-449f-8000-74f6b2064dfd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:29:21.553406 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4d5be95-da2c-449f-8000-74f6b2064dfd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:29:21.559571 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4d5be95-da2c-449f-8000-74f6b2064dfd service neutron] RBAC: Authorization granted {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:29:21.565188 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: [pid: 88550|app: 0|req: 627/1242] 10.222.0.26 () {60 vars in 1365 bytes} [Wed Aug 17 19:29:21 2022] GET /identity/v3/auth/tokens => generated 2863 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 19:29:22.419081 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49559cf2-1557-41b8-b5f3-e2b28ba6987c service neutron] Authenticating user token {{(pid=88551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:29:22.431953 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49559cf2-1557-41b8-b5f3-e2b28ba6987c service neutron] Validating token access rules against request {{(pid=88551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:29:22.436992 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc572a65-7b04-4397-ad49-04cd7e2a5899 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ae23e7a10d54989a25c9f3019184d01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4bbf6c5abd684d899d09a08b0847d81c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:29:22.437652 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc572a65-7b04-4397-ad49-04cd7e2a5899 service nova] REQUEST_METHOD: `GET` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:29:22.437922 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc572a65-7b04-4397-ad49-04cd7e2a5899 service nova] SCRIPT_NAME: `/identity` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:29:22.438318 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc572a65-7b04-4397-ad49-04cd7e2a5899 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:29:22.448307 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc572a65-7b04-4397-ad49-04cd7e2a5899 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:29:22.450064 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc572a65-7b04-4397-ad49-04cd7e2a5899 service nova] RBAC: Authorization granted {{(pid=88551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:29:22.462045 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: [pid: 88551|app: 0|req: 616/1243] 10.222.0.26 () {60 vars in 1365 bytes} [Wed Aug 17 19:29:22 2022] GET /identity/v3/auth/tokens => generated 2863 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 19:29:31.560756 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG dbcounter [-] [88550] Writing DB stats keystone:SELECT=6 {{(pid=88550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:29:32.456668 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG dbcounter [-] [88551] Writing DB stats keystone:SELECT=6 {{(pid=88551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:29:34.261984 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e972d311-18ee-4269-a4bc-d33cbf820c3c None None] REQUEST_METHOD: `POST` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:29:34.262518 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e972d311-18ee-4269-a4bc-d33cbf820c3c None None] SCRIPT_NAME: `/identity` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:29:34.262518 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e972d311-18ee-4269-a4bc-d33cbf820c3c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:29:34.282037 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.auth.core [None req-e972d311-18ee-4269-a4bc-d33cbf820c3c None None] MFA Rules not processed for user `77e3bb307c76401f8d2e8bdf0cb15cf2`. Rule list: `[]` (Enabled: `True`). {{(pid=88550) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 19:29:34.283302 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.common.fernet_utils [None req-e972d311-18ee-4269-a4bc-d33cbf820c3c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:29:34.291689 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: [pid: 88550|app: 0|req: 628/1244] 10.222.0.26 () {58 vars in 958 bytes} [Wed Aug 17 19:29:34 2022] POST /identity/v3/auth/tokens => generated 2822 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 19:29:35.047083 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc572a65-7b04-4397-ad49-04cd7e2a5899 service nova] Authenticating user token {{(pid=88551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:29:35.061781 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc572a65-7b04-4397-ad49-04cd7e2a5899 service nova] Validating token access rules against request {{(pid=88551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:29:35.068728 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3d63687-e642-430c-a4ae-63a70c855cce service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6478a47e33024d1abc99f078dbc30787', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4bbf6c5abd684d899d09a08b0847d81c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:29:35.069833 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d63687-e642-430c-a4ae-63a70c855cce service placement] REQUEST_METHOD: `GET` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:29:35.070127 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d63687-e642-430c-a4ae-63a70c855cce service placement] SCRIPT_NAME: `/identity` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:29:35.070489 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d63687-e642-430c-a4ae-63a70c855cce service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:29:35.081861 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3d63687-e642-430c-a4ae-63a70c855cce service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=88551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:29:35.084008 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3d63687-e642-430c-a4ae-63a70c855cce service placement] RBAC: Authorization granted {{(pid=88551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:29:35.095636 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: [pid: 88551|app: 0|req: 617/1245] 10.222.0.26 () {60 vars in 1365 bytes} [Wed Aug 17 19:29:35 2022] GET /identity/v3/auth/tokens => generated 2868 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 19:29:44.277110 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG dbcounter [-] [88550] Writing DB stats keystone:SELECT=3 {{(pid=88550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:29:45.091004 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG dbcounter [-] [88551] Writing DB stats keystone:SELECT=6 {{(pid=88551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:29:55.731883 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e972d311-18ee-4269-a4bc-d33cbf820c3c None None] Authenticating user token {{(pid=88550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:29:55.746505 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e972d311-18ee-4269-a4bc-d33cbf820c3c None None] Validating token access rules against request {{(pid=88550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:29:55.752923 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b364331a-721b-4497-8188-ab0f5d288811 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ae23e7a10d54989a25c9f3019184d01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4bbf6c5abd684d899d09a08b0847d81c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:29:55.755291 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b364331a-721b-4497-8188-ab0f5d288811 service nova] REQUEST_METHOD: `GET` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:29:55.755291 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b364331a-721b-4497-8188-ab0f5d288811 service nova] SCRIPT_NAME: `/identity` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:29:55.755291 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b364331a-721b-4497-8188-ab0f5d288811 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:29:55.763687 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b364331a-721b-4497-8188-ab0f5d288811 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:29:55.765308 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b364331a-721b-4497-8188-ab0f5d288811 service nova] RBAC: Authorization granted {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:29:55.775656 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: [pid: 88550|app: 0|req: 629/1246] 10.222.0.26 () {60 vars in 1365 bytes} [Wed Aug 17 19:29:55 2022] GET /identity/v3/auth/tokens => generated 2863 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 19:30:05.771560 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG dbcounter [-] [88550] Writing DB stats keystone:SELECT=6 {{(pid=88550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:30:08.399191 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3d63687-e642-430c-a4ae-63a70c855cce service placement] Authenticating user token {{(pid=88551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:30:08.408288 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3d63687-e642-430c-a4ae-63a70c855cce service placement] Validating token access rules against request {{(pid=88551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:30:08.412052 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2be6fb9-34d7-423a-b846-5b96b9d510a5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8240f6e0b65545708f07e040c09e1490', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4bbf6c5abd684d899d09a08b0847d81c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:30:08.412679 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2be6fb9-34d7-423a-b846-5b96b9d510a5 service neutron] REQUEST_METHOD: `GET` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:30:08.412954 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2be6fb9-34d7-423a-b846-5b96b9d510a5 service neutron] SCRIPT_NAME: `/identity` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:30:08.413223 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2be6fb9-34d7-423a-b846-5b96b9d510a5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:30:08.422809 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2be6fb9-34d7-423a-b846-5b96b9d510a5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:30:08.424235 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2be6fb9-34d7-423a-b846-5b96b9d510a5 service neutron] RBAC: Authorization granted {{(pid=88551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:30:08.434245 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: [pid: 88551|app: 0|req: 618/1247] 10.222.0.26 () {60 vars in 1365 bytes} [Wed Aug 17 19:30:08 2022] GET /identity/v3/auth/tokens => generated 2887 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 19:30:10.408316 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b364331a-721b-4497-8188-ab0f5d288811 service nova] Authenticating user token {{(pid=88550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:30:10.419594 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b364331a-721b-4497-8188-ab0f5d288811 service nova] Validating token access rules against request {{(pid=88550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:30:10.426099 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d790a2ed-29a4-4f2c-bc88-7bbc38dc9f9f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ae23e7a10d54989a25c9f3019184d01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4bbf6c5abd684d899d09a08b0847d81c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:30:10.426791 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d790a2ed-29a4-4f2c-bc88-7bbc38dc9f9f service nova] REQUEST_METHOD: `GET` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:30:10.427152 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d790a2ed-29a4-4f2c-bc88-7bbc38dc9f9f service nova] SCRIPT_NAME: `/identity` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:30:10.427425 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d790a2ed-29a4-4f2c-bc88-7bbc38dc9f9f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:30:10.437175 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d790a2ed-29a4-4f2c-bc88-7bbc38dc9f9f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:30:10.438818 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d790a2ed-29a4-4f2c-bc88-7bbc38dc9f9f service nova] RBAC: Authorization granted {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:30:10.450503 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: [pid: 88550|app: 0|req: 630/1248] 10.222.0.26 () {60 vars in 1365 bytes} [Wed Aug 17 19:30:10 2022] GET /identity/v3/auth/tokens => generated 2863 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 19:30:18.429987 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG dbcounter [-] [88551] Writing DB stats keystone:SELECT=6 {{(pid=88551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:30:20.445888 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG dbcounter [-] [88550] Writing DB stats keystone:SELECT=6 {{(pid=88550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:32:20.838928 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2be6fb9-34d7-423a-b846-5b96b9d510a5 service neutron] Authenticating user token {{(pid=88551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:32:20.850985 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2be6fb9-34d7-423a-b846-5b96b9d510a5 service neutron] Validating token access rules against request {{(pid=88551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:32:20.856383 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0f3eace-5ce9-42e7-87bc-3750751bbf35 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6478a47e33024d1abc99f078dbc30787', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4bbf6c5abd684d899d09a08b0847d81c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:32:20.857008 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f3eace-5ce9-42e7-87bc-3750751bbf35 service placement] REQUEST_METHOD: `GET` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:32:20.857276 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f3eace-5ce9-42e7-87bc-3750751bbf35 service placement] SCRIPT_NAME: `/identity` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:32:20.857550 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f3eace-5ce9-42e7-87bc-3750751bbf35 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:32:20.859684 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.common.fernet_utils [None req-e0f3eace-5ce9-42e7-87bc-3750751bbf35 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:32:20.885939 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0f3eace-5ce9-42e7-87bc-3750751bbf35 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=88551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:32:20.887578 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0f3eace-5ce9-42e7-87bc-3750751bbf35 service placement] RBAC: Authorization granted {{(pid=88551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:32:20.898451 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: [pid: 88551|app: 0|req: 619/1249] 10.222.0.26 () {60 vars in 1365 bytes} [Wed Aug 17 19:32:20 2022] GET /identity/v3/auth/tokens => generated 2868 bytes in 60 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 19:32:30.894238 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG dbcounter [-] [88551] Writing DB stats keystone:SELECT=11 {{(pid=88551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:32:34.815956 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d790a2ed-29a4-4f2c-bc88-7bbc38dc9f9f service nova] Authenticating user token {{(pid=88550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:32:34.817639 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.common.fernet_utils [None req-d790a2ed-29a4-4f2c-bc88-7bbc38dc9f9f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:32:34.842828 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d790a2ed-29a4-4f2c-bc88-7bbc38dc9f9f service nova] Validating token access rules against request {{(pid=88550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:32:34.846718 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fac76de-8a92-478e-aaf9-804ec8ce6ee6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8240f6e0b65545708f07e040c09e1490', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4bbf6c5abd684d899d09a08b0847d81c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:32:34.847316 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fac76de-8a92-478e-aaf9-804ec8ce6ee6 service neutron] REQUEST_METHOD: `GET` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:32:34.847596 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fac76de-8a92-478e-aaf9-804ec8ce6ee6 service neutron] SCRIPT_NAME: `/identity` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:32:34.847864 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fac76de-8a92-478e-aaf9-804ec8ce6ee6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:32:34.923899 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fac76de-8a92-478e-aaf9-804ec8ce6ee6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:32:34.925467 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fac76de-8a92-478e-aaf9-804ec8ce6ee6 service neutron] RBAC: Authorization granted {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:32:34.947245 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: [pid: 88550|app: 0|req: 631/1250] 10.222.0.26 () {60 vars in 1365 bytes} [Wed Aug 17 19:32:34 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 131 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 19:32:38.767037 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7233c04c-3779-44ba-9495-e61b06ce8713 None None] REQUEST_METHOD: `GET` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:32:38.767857 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7233c04c-3779-44ba-9495-e61b06ce8713 None None] SCRIPT_NAME: `/identity` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:32:38.767857 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7233c04c-3779-44ba-9495-e61b06ce8713 None None] PATH_INFO: `/` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:32:38.769274 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: [pid: 88551|app: 0|req: 620/1251] 10.222.0.26 () {54 vars in 921 bytes} [Wed Aug 17 19:32:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 19:32:38.779317 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2adffd32-0b7f-4424-aef0-6f210a5fec4d None None] REQUEST_METHOD: `POST` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:32:38.779829 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2adffd32-0b7f-4424-aef0-6f210a5fec4d None None] SCRIPT_NAME: `/identity` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:32:38.779917 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2adffd32-0b7f-4424-aef0-6f210a5fec4d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:32:38.819234 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.auth.core [None req-2adffd32-0b7f-4424-aef0-6f210a5fec4d None None] MFA Rules not processed for user `6478a47e33024d1abc99f078dbc30787`. Rule list: `[]` (Enabled: `True`). {{(pid=88550) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 19:32:38.820488 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.common.fernet_utils [None req-2adffd32-0b7f-4424-aef0-6f210a5fec4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:32:38.829802 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: [pid: 88550|app: 0|req: 632/1252] 10.222.0.26 () {58 vars in 1018 bytes} [Wed Aug 17 19:32:38 2022] POST /identity/v3/auth/tokens => generated 2868 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 19:32:38.840609 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7233c04c-3779-44ba-9495-e61b06ce8713 None None] Authenticating user token {{(pid=88551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:32:38.853954 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7233c04c-3779-44ba-9495-e61b06ce8713 None None] Validating token access rules against request {{(pid=88551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:32:38.858791 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3b1475c-1b63-482c-b52f-19b6199ed8c2 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6478a47e33024d1abc99f078dbc30787', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4bbf6c5abd684d899d09a08b0847d81c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:32:38.864781 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b1475c-1b63-482c-b52f-19b6199ed8c2 service placement] REQUEST_METHOD: `GET` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:32:38.864781 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b1475c-1b63-482c-b52f-19b6199ed8c2 service placement] SCRIPT_NAME: `/identity` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:32:38.864781 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b1475c-1b63-482c-b52f-19b6199ed8c2 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:32:38.871004 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3b1475c-1b63-482c-b52f-19b6199ed8c2 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=88551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:32:38.872638 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3b1475c-1b63-482c-b52f-19b6199ed8c2 service placement] RBAC: Authorization granted {{(pid=88551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:32:38.883419 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: [pid: 88551|app: 0|req: 621/1253] 10.222.0.26 () {60 vars in 1365 bytes} [Wed Aug 17 19:32:38 2022] GET /identity/v3/auth/tokens => generated 2868 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 17 19:32:40.150156 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2adffd32-0b7f-4424-aef0-6f210a5fec4d None None] Authenticating user token {{(pid=88550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:32:40.160606 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2adffd32-0b7f-4424-aef0-6f210a5fec4d None None] Validating token access rules against request {{(pid=88550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:32:40.164612 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4757e667-961b-47df-9271-9c4a7c25835e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8240f6e0b65545708f07e040c09e1490', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4bbf6c5abd684d899d09a08b0847d81c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:32:40.166777 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4757e667-961b-47df-9271-9c4a7c25835e service neutron] REQUEST_METHOD: `GET` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:32:40.166777 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4757e667-961b-47df-9271-9c4a7c25835e service neutron] SCRIPT_NAME: `/identity` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:32:40.166777 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4757e667-961b-47df-9271-9c4a7c25835e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:32:40.176463 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4757e667-961b-47df-9271-9c4a7c25835e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:32:40.177904 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4757e667-961b-47df-9271-9c4a7c25835e service neutron] RBAC: Authorization granted {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:32:40.188887 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: [pid: 88550|app: 0|req: 633/1254] 10.222.0.26 () {60 vars in 1365 bytes} [Wed Aug 17 19:32:40 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 19:32:42.627078 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c7f2611-00e6-46f5-8383-9a61686ddeb5 None None] REQUEST_METHOD: `GET` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:32:42.627575 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c7f2611-00e6-46f5-8383-9a61686ddeb5 None None] SCRIPT_NAME: `/identity` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:32:42.627665 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c7f2611-00e6-46f5-8383-9a61686ddeb5 None None] PATH_INFO: `/` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:32:42.629006 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: [pid: 88551|app: 0|req: 622/1255] 10.222.0.26 () {54 vars in 921 bytes} [Wed Aug 17 19:32:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 19:32:42.649194 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f28eda0-909b-4207-8ba3-2672c48c46d6 None None] REQUEST_METHOD: `POST` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:32:42.649702 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f28eda0-909b-4207-8ba3-2672c48c46d6 None None] SCRIPT_NAME: `/identity` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:32:42.649792 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f28eda0-909b-4207-8ba3-2672c48c46d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:32:42.676295 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.auth.core [None req-9f28eda0-909b-4207-8ba3-2672c48c46d6 None None] MFA Rules not processed for user `6478a47e33024d1abc99f078dbc30787`. Rule list: `[]` (Enabled: `True`). {{(pid=88550) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 19:32:42.677588 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.common.fernet_utils [None req-9f28eda0-909b-4207-8ba3-2672c48c46d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:32:42.711894 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: [pid: 88550|app: 0|req: 634/1256] 10.222.0.26 () {58 vars in 1018 bytes} [Wed Aug 17 19:32:42 2022] POST /identity/v3/auth/tokens => generated 2868 bytes in 63 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 19:32:42.724444 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c7f2611-00e6-46f5-8383-9a61686ddeb5 None None] Authenticating user token {{(pid=88551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:32:42.740654 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c7f2611-00e6-46f5-8383-9a61686ddeb5 None None] Validating token access rules against request {{(pid=88551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:32:42.749545 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74344ae7-e986-4383-bee8-410f68ce1c2d service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6478a47e33024d1abc99f078dbc30787', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4bbf6c5abd684d899d09a08b0847d81c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:32:42.749545 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74344ae7-e986-4383-bee8-410f68ce1c2d service placement] REQUEST_METHOD: `GET` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:32:42.749545 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74344ae7-e986-4383-bee8-410f68ce1c2d service placement] SCRIPT_NAME: `/identity` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:32:42.749545 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74344ae7-e986-4383-bee8-410f68ce1c2d service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:32:42.756345 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74344ae7-e986-4383-bee8-410f68ce1c2d service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=88551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:32:42.757941 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74344ae7-e986-4383-bee8-410f68ce1c2d service placement] RBAC: Authorization granted {{(pid=88551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:32:42.769303 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: [pid: 88551|app: 0|req: 623/1257] 10.222.0.26 () {60 vars in 1365 bytes} [Wed Aug 17 19:32:42 2022] GET /identity/v3/auth/tokens => generated 2868 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 19:32:42.859286 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f28eda0-909b-4207-8ba3-2672c48c46d6 None None] Authenticating user token {{(pid=88550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:32:42.872249 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f28eda0-909b-4207-8ba3-2672c48c46d6 None None] Validating token access rules against request {{(pid=88550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:32:42.877550 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-706bf166-1328-4825-808e-d470968b32a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '819d41a279e64291acc60de51e1530ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0490e0db9a14e81a7ea7b108a7ad6a0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:32:42.878220 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-706bf166-1328-4825-808e-d470968b32a2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:32:42.878523 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-706bf166-1328-4825-808e-d470968b32a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:32:42.878831 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-706bf166-1328-4825-808e-d470968b32a2 admin admin] PATH_INFO: `/v3/users/0ccfad6221274bb6ac716060588841d9` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:32:42.880039 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-706bf166-1328-4825-808e-d470968b32a2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0ccfad6221274bb6ac716060588841d9)` {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:32:42.882125 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-706bf166-1328-4825-808e-d470968b32a2 admin admin] RBAC: Authorization granted {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:32:43.024572 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.notifications [None req-706bf166-1328-4825-808e-d470968b32a2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0ccfad6221274bb6ac716060588841d9'} {{(pid=88550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 19:32:43.118585 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.notifications [None req-706bf166-1328-4825-808e-d470968b32a2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0ccfad6221274bb6ac716060588841d9'} {{(pid=88550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 19:32:43.119306 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.notifications [None req-706bf166-1328-4825-808e-d470968b32a2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0ccfad6221274bb6ac716060588841d9'} {{(pid=88550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 19:32:43.138871 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.notifications [None req-706bf166-1328-4825-808e-d470968b32a2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0ccfad6221274bb6ac716060588841d9'} {{(pid=88550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 19:32:43.139752 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.notifications [None req-706bf166-1328-4825-808e-d470968b32a2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0ccfad6221274bb6ac716060588841d9'} {{(pid=88550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 19:32:43.178606 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG dbcounter [-] [88550] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:32:43.197818 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: [pid: 88550|app: 0|req: 635/1258] 10.222.0.26 () {58 vars in 1224 bytes} [Wed Aug 17 19:32:42 2022] DELETE /identity/v3/users/0ccfad6221274bb6ac716060588841d9 => generated 0 bytes in 334 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 19:32:43.470698 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74344ae7-e986-4383-bee8-410f68ce1c2d service placement] Authenticating user token {{(pid=88551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:32:43.482405 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74344ae7-e986-4383-bee8-410f68ce1c2d service placement] Validating token access rules against request {{(pid=88551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:32:43.573199 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04dde8cd-8c0e-40c4-865d-af7e3b3facb2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '819d41a279e64291acc60de51e1530ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0490e0db9a14e81a7ea7b108a7ad6a0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:32:43.573924 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04dde8cd-8c0e-40c4-865d-af7e3b3facb2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:32:43.574439 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04dde8cd-8c0e-40c4-865d-af7e3b3facb2 admin admin] SCRIPT_NAME: `/identity` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:32:43.574820 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04dde8cd-8c0e-40c4-865d-af7e3b3facb2 admin admin] PATH_INFO: `/v3/projects/e895dbdff1074a30a40979cbf4731a9d` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:32:43.576077 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04dde8cd-8c0e-40c4-865d-af7e3b3facb2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e895dbdff1074a30a40979cbf4731a9d)` {{(pid=88551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:32:43.578188 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04dde8cd-8c0e-40c4-865d-af7e3b3facb2 admin admin] RBAC: Authorization granted {{(pid=88551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:32:43.751361 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.notifications [None req-04dde8cd-8c0e-40c4-865d-af7e3b3facb2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e895dbdff1074a30a40979cbf4731a9d', 'request_id': 'req-04dde8cd-8c0e-40c4-865d-af7e3b3facb2'} {{(pid=88551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 19:32:43.814495 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.notifications [None req-04dde8cd-8c0e-40c4-865d-af7e3b3facb2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e895dbdff1074a30a40979cbf4731a9d', 'request_id': 'req-04dde8cd-8c0e-40c4-865d-af7e3b3facb2'} {{(pid=88551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 19:32:43.826210 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.notifications [None req-04dde8cd-8c0e-40c4-865d-af7e3b3facb2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e895dbdff1074a30a40979cbf4731a9d', 'request_id': 'req-04dde8cd-8c0e-40c4-865d-af7e3b3facb2'} {{(pid=88551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 19:32:43.885058 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.notifications [None req-04dde8cd-8c0e-40c4-865d-af7e3b3facb2 admin admin] The token cache is being invalidate because project e895dbdff1074a30a40979cbf4731a9d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88551) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 17 19:32:43.886333 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.notifications [None req-04dde8cd-8c0e-40c4-865d-af7e3b3facb2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 19:32:43.888927 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.notifications [None req-04dde8cd-8c0e-40c4-865d-af7e3b3facb2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 19:32:43.893018 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: [pid: 88551|app: 0|req: 624/1259] 10.222.0.26 () {58 vars in 1233 bytes} [Wed Aug 17 19:32:43 2022] DELETE /identity/v3/projects/e895dbdff1074a30a40979cbf4731a9d => generated 0 bytes in 423 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 19:32:43.896656 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-706bf166-1328-4825-808e-d470968b32a2 admin admin] Authenticating user token {{(pid=88550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:32:43.898453 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.common.fernet_utils [None req-706bf166-1328-4825-808e-d470968b32a2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:32:43.923277 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-706bf166-1328-4825-808e-d470968b32a2 admin admin] Validating token access rules against request {{(pid=88550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:32:43.994907 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2180a8a-c021-4d35-9496-9d3b7af217fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '819d41a279e64291acc60de51e1530ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0490e0db9a14e81a7ea7b108a7ad6a0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:32:43.995637 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2180a8a-c021-4d35-9496-9d3b7af217fa admin admin] REQUEST_METHOD: `DELETE` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:32:43.995917 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2180a8a-c021-4d35-9496-9d3b7af217fa admin admin] SCRIPT_NAME: `/identity` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:32:43.996192 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2180a8a-c021-4d35-9496-9d3b7af217fa admin admin] PATH_INFO: `/v3/users/1ee8d76f9e454235bfe30aedacb11063` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:32:43.997333 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2180a8a-c021-4d35-9496-9d3b7af217fa admin admin] RBAC: Authorizing `identity:delete_user(user_id=1ee8d76f9e454235bfe30aedacb11063)` {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:32:43.999430 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2180a8a-c021-4d35-9496-9d3b7af217fa admin admin] RBAC: Authorization granted {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:32:44.294994 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.notifications [None req-c2180a8a-c021-4d35-9496-9d3b7af217fa admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1ee8d76f9e454235bfe30aedacb11063'} {{(pid=88550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 19:32:44.352284 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.notifications [None req-c2180a8a-c021-4d35-9496-9d3b7af217fa admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1ee8d76f9e454235bfe30aedacb11063'} {{(pid=88550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 19:32:44.352923 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.notifications [None req-c2180a8a-c021-4d35-9496-9d3b7af217fa admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1ee8d76f9e454235bfe30aedacb11063'} {{(pid=88550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 19:32:44.360983 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.notifications [None req-c2180a8a-c021-4d35-9496-9d3b7af217fa admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1ee8d76f9e454235bfe30aedacb11063'} {{(pid=88550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 19:32:44.361973 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.notifications [None req-c2180a8a-c021-4d35-9496-9d3b7af217fa admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1ee8d76f9e454235bfe30aedacb11063'} {{(pid=88550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 19:32:44.399701 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: [pid: 88550|app: 0|req: 636/1260] 10.222.0.26 () {58 vars in 1224 bytes} [Wed Aug 17 19:32:43 2022] DELETE /identity/v3/users/1ee8d76f9e454235bfe30aedacb11063 => generated 0 bytes in 488 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 19:32:44.905657 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04dde8cd-8c0e-40c4-865d-af7e3b3facb2 admin admin] Authenticating user token {{(pid=88551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:32:44.907418 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.common.fernet_utils [None req-04dde8cd-8c0e-40c4-865d-af7e3b3facb2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:32:44.919972 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04dde8cd-8c0e-40c4-865d-af7e3b3facb2 admin admin] Validating token access rules against request {{(pid=88551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:32:44.977170 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG dbcounter [-] [88551] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=88551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:32:44.986683 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65f3edc0-c5a2-4383-8b04-0a4d34c00d1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '819d41a279e64291acc60de51e1530ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0490e0db9a14e81a7ea7b108a7ad6a0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:32:44.987312 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f3edc0-c5a2-4383-8b04-0a4d34c00d1e admin admin] REQUEST_METHOD: `DELETE` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:32:44.987587 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f3edc0-c5a2-4383-8b04-0a4d34c00d1e admin admin] SCRIPT_NAME: `/identity` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:32:44.987859 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f3edc0-c5a2-4383-8b04-0a4d34c00d1e admin admin] PATH_INFO: `/v3/projects/4af36deed39644a8bd7b8c4d77c7d445` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:32:44.989008 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65f3edc0-c5a2-4383-8b04-0a4d34c00d1e admin admin] RBAC: Authorizing `identity:delete_project(project_id=4af36deed39644a8bd7b8c4d77c7d445)` {{(pid=88551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:32:44.990977 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65f3edc0-c5a2-4383-8b04-0a4d34c00d1e admin admin] RBAC: Authorization granted {{(pid=88551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:32:45.098184 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.notifications [None req-65f3edc0-c5a2-4383-8b04-0a4d34c00d1e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4af36deed39644a8bd7b8c4d77c7d445', 'request_id': 'req-65f3edc0-c5a2-4383-8b04-0a4d34c00d1e'} {{(pid=88551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 19:32:45.215075 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.notifications [None req-65f3edc0-c5a2-4383-8b04-0a4d34c00d1e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4af36deed39644a8bd7b8c4d77c7d445', 'request_id': 'req-65f3edc0-c5a2-4383-8b04-0a4d34c00d1e'} {{(pid=88551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 19:32:45.222503 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.notifications [None req-65f3edc0-c5a2-4383-8b04-0a4d34c00d1e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4af36deed39644a8bd7b8c4d77c7d445', 'request_id': 'req-65f3edc0-c5a2-4383-8b04-0a4d34c00d1e'} {{(pid=88551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 19:32:45.232770 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.notifications [None req-65f3edc0-c5a2-4383-8b04-0a4d34c00d1e admin admin] The token cache is being invalidate because project 4af36deed39644a8bd7b8c4d77c7d445 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88551) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 17 19:32:45.233054 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.notifications [None req-65f3edc0-c5a2-4383-8b04-0a4d34c00d1e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 19:32:45.233700 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.notifications [None req-65f3edc0-c5a2-4383-8b04-0a4d34c00d1e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 19:32:45.236067 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: [pid: 88551|app: 0|req: 625/1261] 10.222.0.26 () {58 vars in 1233 bytes} [Wed Aug 17 19:32:44 2022] DELETE /identity/v3/projects/4af36deed39644a8bd7b8c4d77c7d445 => generated 0 bytes in 331 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 19:32:48.259699 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2180a8a-c021-4d35-9496-9d3b7af217fa admin admin] Authenticating user token {{(pid=88550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:32:48.262112 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.common.fernet_utils [None req-c2180a8a-c021-4d35-9496-9d3b7af217fa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:32:48.278844 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2180a8a-c021-4d35-9496-9d3b7af217fa admin admin] Validating token access rules against request {{(pid=88550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:32:48.336910 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc594865-11ca-47a9-8af4-55588857dd17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '819d41a279e64291acc60de51e1530ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0490e0db9a14e81a7ea7b108a7ad6a0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:32:48.337443 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc594865-11ca-47a9-8af4-55588857dd17 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:32:48.337724 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc594865-11ca-47a9-8af4-55588857dd17 admin admin] SCRIPT_NAME: `/identity` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:32:48.337997 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc594865-11ca-47a9-8af4-55588857dd17 admin admin] PATH_INFO: `/v3/users/77e3bb307c76401f8d2e8bdf0cb15cf2` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:32:48.339139 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc594865-11ca-47a9-8af4-55588857dd17 admin admin] RBAC: Authorizing `identity:delete_user(user_id=77e3bb307c76401f8d2e8bdf0cb15cf2)` {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:32:48.341126 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc594865-11ca-47a9-8af4-55588857dd17 admin admin] RBAC: Authorization granted {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:32:48.363297 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG dbcounter [-] [88550] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=88550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:32:48.655627 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.notifications [None req-cc594865-11ca-47a9-8af4-55588857dd17 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '77e3bb307c76401f8d2e8bdf0cb15cf2'} {{(pid=88550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 19:32:48.734781 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.notifications [None req-cc594865-11ca-47a9-8af4-55588857dd17 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '77e3bb307c76401f8d2e8bdf0cb15cf2'} {{(pid=88550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 19:32:48.735426 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.notifications [None req-cc594865-11ca-47a9-8af4-55588857dd17 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '77e3bb307c76401f8d2e8bdf0cb15cf2'} {{(pid=88550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 19:32:48.742983 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.notifications [None req-cc594865-11ca-47a9-8af4-55588857dd17 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '77e3bb307c76401f8d2e8bdf0cb15cf2'} {{(pid=88550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 19:32:48.743664 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.notifications [None req-cc594865-11ca-47a9-8af4-55588857dd17 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '77e3bb307c76401f8d2e8bdf0cb15cf2'} {{(pid=88550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 19:32:48.766639 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: [pid: 88550|app: 0|req: 637/1262] 10.222.0.26 () {58 vars in 1224 bytes} [Wed Aug 17 19:32:48 2022] DELETE /identity/v3/users/77e3bb307c76401f8d2e8bdf0cb15cf2 => generated 0 bytes in 505 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 19:32:49.033945 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65f3edc0-c5a2-4383-8b04-0a4d34c00d1e admin admin] Authenticating user token {{(pid=88551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:32:49.035470 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.common.fernet_utils [None req-65f3edc0-c5a2-4383-8b04-0a4d34c00d1e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:32:49.051460 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65f3edc0-c5a2-4383-8b04-0a4d34c00d1e admin admin] Validating token access rules against request {{(pid=88551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:32:49.111044 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5898638-8974-4805-946b-b0f4b6e01a39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '819d41a279e64291acc60de51e1530ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0490e0db9a14e81a7ea7b108a7ad6a0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:32:49.111672 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5898638-8974-4805-946b-b0f4b6e01a39 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:32:49.111950 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5898638-8974-4805-946b-b0f4b6e01a39 admin admin] SCRIPT_NAME: `/identity` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:32:49.112221 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5898638-8974-4805-946b-b0f4b6e01a39 admin admin] PATH_INFO: `/v3/projects/d02c2069ce1b432891b6635b4339dfa8` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:32:49.113347 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5898638-8974-4805-946b-b0f4b6e01a39 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d02c2069ce1b432891b6635b4339dfa8)` {{(pid=88551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:32:49.115307 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5898638-8974-4805-946b-b0f4b6e01a39 admin admin] RBAC: Authorization granted {{(pid=88551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:32:49.289781 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.notifications [None req-e5898638-8974-4805-946b-b0f4b6e01a39 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd02c2069ce1b432891b6635b4339dfa8', 'request_id': 'req-e5898638-8974-4805-946b-b0f4b6e01a39'} {{(pid=88551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 19:32:49.351737 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.notifications [None req-e5898638-8974-4805-946b-b0f4b6e01a39 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd02c2069ce1b432891b6635b4339dfa8', 'request_id': 'req-e5898638-8974-4805-946b-b0f4b6e01a39'} {{(pid=88551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 19:32:49.358861 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.notifications [None req-e5898638-8974-4805-946b-b0f4b6e01a39 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd02c2069ce1b432891b6635b4339dfa8', 'request_id': 'req-e5898638-8974-4805-946b-b0f4b6e01a39'} {{(pid=88551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 19:32:49.370248 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.notifications [None req-e5898638-8974-4805-946b-b0f4b6e01a39 admin admin] The token cache is being invalidate because project d02c2069ce1b432891b6635b4339dfa8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88551) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 17 19:32:49.370581 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.notifications [None req-e5898638-8974-4805-946b-b0f4b6e01a39 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 19:32:49.371243 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.notifications [None req-e5898638-8974-4805-946b-b0f4b6e01a39 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 19:32:49.372847 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: [pid: 88551|app: 0|req: 626/1263] 10.222.0.26 () {58 vars in 1233 bytes} [Wed Aug 17 19:32:49 2022] DELETE /identity/v3/projects/d02c2069ce1b432891b6635b4339dfa8 => generated 0 bytes in 339 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 19:32:49.377841 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc594865-11ca-47a9-8af4-55588857dd17 admin admin] Authenticating user token {{(pid=88550) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:32:49.380038 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.common.fernet_utils [None req-cc594865-11ca-47a9-8af4-55588857dd17 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88550) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:32:49.392981 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc594865-11ca-47a9-8af4-55588857dd17 admin admin] Validating token access rules against request {{(pid=88550) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:32:49.451944 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2c4e4f4-1b8a-402b-a0c6-ddc88e161350 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '819d41a279e64291acc60de51e1530ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0490e0db9a14e81a7ea7b108a7ad6a0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88550) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:32:49.452572 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c4e4f4-1b8a-402b-a0c6-ddc88e161350 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:32:49.452851 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c4e4f4-1b8a-402b-a0c6-ddc88e161350 admin admin] SCRIPT_NAME: `/identity` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:32:49.453128 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c4e4f4-1b8a-402b-a0c6-ddc88e161350 admin admin] PATH_INFO: `/v3/users/c52a5447bdbf42eca846b8571a5b823c` {{(pid=88550) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:32:49.454574 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2c4e4f4-1b8a-402b-a0c6-ddc88e161350 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c52a5447bdbf42eca846b8571a5b823c)` {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:32:49.456526 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2c4e4f4-1b8a-402b-a0c6-ddc88e161350 admin admin] RBAC: Authorization granted {{(pid=88550) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:32:49.691481 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.notifications [None req-d2c4e4f4-1b8a-402b-a0c6-ddc88e161350 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c52a5447bdbf42eca846b8571a5b823c'} {{(pid=88550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 19:32:49.763210 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.notifications [None req-d2c4e4f4-1b8a-402b-a0c6-ddc88e161350 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c52a5447bdbf42eca846b8571a5b823c'} {{(pid=88550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 19:32:49.764038 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.notifications [None req-d2c4e4f4-1b8a-402b-a0c6-ddc88e161350 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c52a5447bdbf42eca846b8571a5b823c'} {{(pid=88550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 19:32:49.772013 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.notifications [None req-d2c4e4f4-1b8a-402b-a0c6-ddc88e161350 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c52a5447bdbf42eca846b8571a5b823c'} {{(pid=88550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 19:32:49.772737 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG keystone.notifications [None req-d2c4e4f4-1b8a-402b-a0c6-ddc88e161350 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c52a5447bdbf42eca846b8571a5b823c'} {{(pid=88550) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 19:32:49.790830 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: [pid: 88550|app: 0|req: 638/1264] 10.222.0.26 () {58 vars in 1224 bytes} [Wed Aug 17 19:32:49 2022] DELETE /identity/v3/users/c52a5447bdbf42eca846b8571a5b823c => generated 0 bytes in 414 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 19:32:50.061931 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5898638-8974-4805-946b-b0f4b6e01a39 admin admin] Authenticating user token {{(pid=88551) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:32:50.063719 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.common.fernet_utils [None req-e5898638-8974-4805-946b-b0f4b6e01a39 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88551) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:32:50.080608 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5898638-8974-4805-946b-b0f4b6e01a39 admin admin] Validating token access rules against request {{(pid=88551) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:32:50.091872 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG dbcounter [-] [88551] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=88551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:32:50.141437 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bf1ce6a-0858-4812-a3ab-8e7010081bd4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '819d41a279e64291acc60de51e1530ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0490e0db9a14e81a7ea7b108a7ad6a0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88551) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:32:50.142095 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf1ce6a-0858-4812-a3ab-8e7010081bd4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:32:50.142374 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf1ce6a-0858-4812-a3ab-8e7010081bd4 admin admin] SCRIPT_NAME: `/identity` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:32:50.142681 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf1ce6a-0858-4812-a3ab-8e7010081bd4 admin admin] PATH_INFO: `/v3/projects/8d36522364df449897dae7d1b3893144` {{(pid=88551) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:32:50.143810 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bf1ce6a-0858-4812-a3ab-8e7010081bd4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8d36522364df449897dae7d1b3893144)` {{(pid=88551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:32:50.146153 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bf1ce6a-0858-4812-a3ab-8e7010081bd4 admin admin] RBAC: Authorization granted {{(pid=88551) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:32:50.300917 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.notifications [None req-1bf1ce6a-0858-4812-a3ab-8e7010081bd4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8d36522364df449897dae7d1b3893144', 'request_id': 'req-1bf1ce6a-0858-4812-a3ab-8e7010081bd4'} {{(pid=88551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 19:32:50.392847 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.notifications [None req-1bf1ce6a-0858-4812-a3ab-8e7010081bd4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8d36522364df449897dae7d1b3893144', 'request_id': 'req-1bf1ce6a-0858-4812-a3ab-8e7010081bd4'} {{(pid=88551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 19:32:50.399953 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.notifications [None req-1bf1ce6a-0858-4812-a3ab-8e7010081bd4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8d36522364df449897dae7d1b3893144', 'request_id': 'req-1bf1ce6a-0858-4812-a3ab-8e7010081bd4'} {{(pid=88551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 19:32:50.410443 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.notifications [None req-1bf1ce6a-0858-4812-a3ab-8e7010081bd4 admin admin] The token cache is being invalidate because project 8d36522364df449897dae7d1b3893144 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88551) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 17 19:32:50.410755 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.notifications [None req-1bf1ce6a-0858-4812-a3ab-8e7010081bd4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 19:32:50.411401 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG keystone.notifications [None req-1bf1ce6a-0858-4812-a3ab-8e7010081bd4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88551) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 19:32:50.412885 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: [pid: 88551|app: 0|req: 627/1265] 10.222.0.26 () {58 vars in 1233 bytes} [Wed Aug 17 19:32:50 2022] DELETE /identity/v3/projects/8d36522364df449897dae7d1b3893144 => generated 0 bytes in 352 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 19:32:59.787370 dv-osbrick-853457-1-ceph devstack@keystone.service[88550]: DEBUG dbcounter [-] [88550] Writing DB stats keystone:DELETE=18,keystone:SELECT=73,keystone:INSERT=2 {{(pid=88550) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:33:00.407463 dv-osbrick-853457-1-ceph devstack@keystone.service[88551]: DEBUG dbcounter [-] [88551] Writing DB stats keystone:SELECT=45,keystone:DELETE=7,keystone:INSERT=1 {{(pid=88551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}